Plugin appears to translate certain unicode characters by adding an extra \n to the output

[Chozothebrozo]

Bepinex - BepInEx bleeding edge version 725 and 729, Unity.IL2CPP-winx-64-6.0.0-be-### versions
Plugin - XUnityAutoTranslator-BepInEx-IL2CPP-5.4.5 and older versions as far back as 5.4.0

Issue Description -
We use this setup to perform Taiwan (Traditional Chinese) to English translations and are seeing recently that the translator seems to have started interpreting certain unicode character sets as their "regular" value while also adding an extra \n newline character. This seems to happen at least for characters in the "Halfwidth and Fullwidth forms" category, as well as "IDEOGRAPHIC FULL STOP". Examples are provided below.

We have also tested this by configuring different translation API endpoints (deepL + deepLLegit + googleV2), as well as running the dialogue strings manually thru those translators via chrome and are not able to reproduce, so it seems this might be something inside of the plugin itself?

Fullstop example -
開始探索。\n大家打起精神來。=Start exploring.\n\nEveryone cheer up.
You can see it changed the "ideographic full stop" period looking character (UTF-8 E3 80 82) to a regular period and added an extra linebreak

Fullwidth examples -
喲，辛苦了！\n今天感覺怎麼樣？=Thank you for your hard work!\n\nHow do you feel today?
Same idea here, it changed the "fullwidth form exclamation mark" (UTF-8 EF BC 81) to a regular exclamation mark and added an extra linebreak

嗯！？=Um!\n?
Interesting enough here, I would have expected it to add two \n but it for some reason only added one

Fullwidth we have also seen examples with Fullwidth left/right parenthesis as well as question marks

Appreciate any inputs you might have on this and whether there might be a config option that could be enabled for this!

[Chozothebrozo]

Adding an update, it seems like this is also happening for standard text now too, example as below. What is very bizarre is that it doesnt appear to be consistent. As in the example, the first two instances of \n do not duplicate, but the last two instances do (and actually triplicate)

안녕하세요, 괴도님!\n아래는 가정의 달 두 번째 특별 선물입니다!\n어서 수령해 주시기 바랍니다.\n\n보상 내용: 미래의 운명10\n\n감사합니다.=Hello, Kaito!\nBelow is the second special gift of the month of the family!\nPlease come and pick it up.\n\n\nCompensation Contents: Future Fate10\n\n\nthank you

[ManlyMarco]

Did you check the whitespace options in the config file? Some of them can affect newlines.

[Chozothebrozo]

Haven't modified any of the whitespace settings from the default config.

Only one that I could think to modify based on this suggestion would be the IgnoreWhitespaceInDialogue and setting it to false maybe? I'll have a couple of the people reporting the problem try that and see if the issue persists

Edit : Had people experiment with setting the above between true/false, no change in behavior