Got error to convert a PDF

[anguslou]

UnicodeEncodeError: 'cp950' codec can't encode character '\uf09f' in position 139457: illegal multibyte sequence

[GKilsgaard]

I am getting this when trying to convert a Danish docx document:
UnicodeEncodeError: 'charmap' codec can't encode character '\u56de' in position 12977: character maps to

[zacken]

Any document in any format written in Norwegian will fail with an error like this (Actual character code changes):
File "C:\Users\HenrikFørli\AppData\Roaming\Python\Python312\site-packages\markitdown\__main__.py", line 47, in <module> main() File "C:\Users\HenrikFørli\AppData\Roaming\Python\Python312\site-packages\markitdown\__main__.py", line 43, in main print(result.text_content) File "C:\Python312\Lib\encodings\cp1252.py", line 19, in encode return codecs.charmap_encode(input,self.errors,encoding_table)[0] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ UnicodeEncodeError: 'charmap' codec can't encode character '\u2264' in position 55937: character maps to <undefined>

[mpetruc]

Not only Norwegian:

File "C:\Users\user1\.local\bin\markitdown.exe\__main__.py", line 8, in <module>
  File "C:\Users\user1\AppData\Roaming\uv\tools\markitdown\Lib\site-packages\markitdown\__main__.py", line 43, in main
    print(result.text_content)
  File "c:\Users\user1\.conda\envs\openai\Lib\encodings\cp1252.py", line 19, in encode
    return codecs.charmap_encode(input,self.errors,encoding_table)[0]
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
UnicodeEncodeError: 'charmap' codec can't encode character '\u2192' in position 20743: character maps to <undefined>

or

UnicodeEncodeError: 'charmap' codec can't encode characters in position 7563-7564: character maps to <undefined>

I've tried numerous pdfs. All except one errored out with the same type of character encoding error.