The fonts comes with Windows (and MS Office) are copyrighted and not redistributable. You cannot just copy and use them on other systems.
For use of PDF, it'll need to be generated on Windows machine, then it could be embedded to the PDF file.
And I think there needs special arrangement to use CJK fonts in PDF files, as Crystal Report before v10.5 also suffers the same problem when trying to create PDF with CJK characters. If the software uses iText, you'll need iText-Asian JAR file for it to work.
I would recommend you to try a font installed on Linux instead, since a lot of those files are in TTF format now, should have decent chance of success.
If the PDF has rendering problem, the best solution is to "convert to curve" these PDF files. Instead of having corresponding characters, you're drawing the glyphs of the characters as lines so it can surely be displayed. The downside is the text would no longer be searchable.
To obtain redistributable license for Microsoft Fonts, you can read from here.