Wouldn't you know, right after I posted I found the answer. I guess if you have xfs running, the font paths you specify in /etc/X11/XF86config will not be used. I had to add the two font paths to /etc/X11/fs/config and restart both xfs and X before the fontpaths would take. Now everything is working.