[SOLVED] Unicode fallback font in gnome-terminal

Cerales · 2017-04-01 23:51:32

UPDATE: this was fixed by installing noto-fonts-cjk, which provided all the glyphs I needed, and fontconfig automatically handled finding a fallback font.

-----

I'm seeing an issue in gnome-terminal where not all Unicode characters are being rendered. I'm not really sure where to begin to understand this - I tried reading up on fontconfig on the Wiki but couldn't see anything directly related.

I'm fiddling with a program for managing id3 tags on MP3s files.

Here's a sample of output:

"Fingerprint":2495105739},{"Title":"夀漀猀栀椀 䌀椀琀礀\u0000","Artist":"夀甀渀最 䰀攀愀渀\u0000","Album":"唀渀欀渀漀眀渀 䴀攀洀漀爀礀\u0000","Fingerprint":3171866406},{"Title":"夀漀甀 䄀椀渀✀琀 䜀漀椀渀最 一漀眀栀攀爀攀\u0000","Artist":"吀栀攀 䜀愀爀戀愀最攀 ☀ 吀栀攀 䘀氀漀眀攀爀猀\u0000","Album":"夀漀甀 䄀椀渀✀琀 䜀漀椀渀最 一漀眀栀攀爀攀 ⼀ 䰀椀瘀攀 䤀渀 一攀眀琀漀眀渀\u0000","Fingerpri
nt":2181524657},{"Title":"夀漀甀 䐀漀渀✀琀","Artist":"吀爀椀挀欀礀","Album":"䴀愀砀椀渀焀甀愀礀攀","Fingerprint":3979305334},{"Title":"夀漀甀✀瘀攀 䜀漀琀 䔀瘀攀爀礀琀栀椀渀最 一漀眀","Artist":"吀栀
攀 匀洀椀琀栀猀","Album":"吀栀攀 匀洀椀琀栀猀","Fingerprint":3462022946},{"Title":"娀礀挀氀漀渀 䈀 娀漀洀戀椀攀","Artist":"吀栀爀漀戀戀椀渀最 䜀爀椀猀琀氀攀","Album":"吀栀攀 匀攀挀漀渀搀 䄀渀渀甀愀
氀 刀攀瀀漀爀琀","Fingerprint":3337563991},{"Title":"愀 洀甀猀琀 昀漀爀 愀氀氀 昀愀挀攀戀漀漀欀攀爀猀","Artist":"唀渀搀攀爀猀挀漀爀攀","Album":"琀椀洀攀 琀漀 最爀椀渀","Fingerprint":3721330545},{"Title":"挀甀爀爀攀渀琀 洀漀漀搀 猀瀀漀漀欀礀 挀栀攀搀搀愀爀","Artist":"唀渀搀攀爀猀挀漀爀攀","Album":"琀椀洀攀 琀漀 最爀椀渀","Fingerprint":2248192584},{"Title":"搀漀渀琀 氀攀琀 礀漀甀爀 挀栀椀氀搀爀
攀渀 戀爀攀愀琀栀攀","Artist":"唀渀搀攀爀猀挀漀爀攀","Album":"琀椀洀攀 琀漀 最爀椀渀","Fingerprint":3495023409},{"Title":"昀洀\u0000","Artist":"The Bad Plus\u0000","Album":"For All I Care\u0000","Fingerprint":2889646918},{"Title":"最漀漀搀 最爀椀攀昀\u0000","Artist":"戀爀漀琀栀攀爀猀 栀愀渀搀 洀椀爀爀漀爀\u0000","Album":"最漀漀搀 最爀椀攀昀 戀ⴀ猀椀搀攀\u0000","Fingerprint":3505597385},{"Title":"氀攀琀琀攀爀 琀漀 琀栀攀 猀甀渀\u0000","Artist":"戀爀漀琀栀攀爀猀 栀愀渀搀 洀椀爀爀漀爀\u0000","Album":"氀攀琀琀攀爀 琀漀 琀栀攀 猀甀渀 ☀ 愀氀猀漀 琀栀攀 洀漀漀渀\u0000","Fingerprint":822142555},{"Title":"洀愀猀栀 洀礀 戀漀渀攀猀","Artist":"唀渀搀攀爀猀挀漀爀攀","Album":"琀椀洀攀 琀漀 最爀椀渀","Fingerprint":4227466261},{"Title":"渀椀挀攀","Artist":"唀渀搀攀爀猀挀漀爀攀","Album":"琀椀洀攀 
琀漀 最爀椀渀","Fingerprint":1391982436},{"Title":"漀甀琀爀漀","Artist":"唀渀搀攀爀猀挀漀爀攀","Album":"琀椀洀攀 琀漀 最爀椀渀","Fingerprint":3834241157},{"Title":"瀀⸀猀⸀ 昀漀爀 琀栀攀 洀漀漀渀\u0000","Artist":"戀爀漀琀栀攀爀猀 栀愀渀搀 洀椀爀爀漀爀\u0000","Album":"氀攀琀琀攀爀 琀漀 琀栀攀 猀甀渀 ☀ 愀氀猀漀 琀栀攀 洀漀漀渀\u0000","Fingerprint":820667103},{"Title":"猀琀甀搀攀渀琀猀 氀椀昀攀","Artist":"唀渀搀攀爀猀挀漀爀攀","Album":"琀椀洀攀 琀漀 最爀椀渀","Fingerprint":2403434765},{"Title":"琀栀攀 挀栀爀椀猀琀洀愀猀 琀甀爀欀攀礀 ⠀眀⼀愀爀攀漀最爀愀瀀栀攀 愀渀搀 挀栀攀爀愀砀 搀攀猀琀爀甀挀琀漀爀⤀","Artist":"唀渀搀攀爀猀挀漀爀攀","Album":"琀椀洀攀 琀漀 最爀椀渀","Fingerprint":2346146673},{"Title":"琀椀洀攀 琀漀 最爀椀渀 ⠀昀攀愀琀⸀ 䄀䰀䔀堀䄀一䐀䔀刀 䌀刀伀匀匀⤀","Artist":"唀渀搀攀爀猀
挀漀爀攀","Album":"琀椀洀攀 琀漀 最爀椀渀","Fingerprint":2006079341},{"Title":"夀漀甀 䄀椀渀✀琀 䜀漀椀渀最 一漀眀栀攀爀攀\u0000","Artist":"吀栀攀 䜀愀爀戀愀最攀 ☀ 吀栀攀 䘀氀漀眀攀爀猀\u0000","Album":"夀漀甀 䄀椀渀✀琀 䜀漀椀渀最 一漀眀栀攀爀攀 ⼀ 䰀椀瘀攀 䤀渀 一攀眀琀漀眀渀\u0000","Fingerprint":618110148}]

I'm not sure how that will render on your browser, or on the wiki here depending on encoding, so here's a screenshot:

http://i.imgur.com/7f40zdz.png

As you can see, there are plenty of Kanji (I think?) characters being rendered correctly - but others incorrectly.

From this think my encoding is fine. I checked gnome-terminal preferences and it's set to utf8.

I've got utf8 in my locale:

$ locale -a | grep utf
en_AU.utf8

Is this just a font issue? If so, where do I begin? Is there some font I can install with universal support for unicode characters, and a way to configure that as a fallback? Or am I barking up the wrong tree altogether?

Last edited by Cerales (2017-04-17 10:23:12)

jasonwryan · 2017-04-02 00:27:31

Read the Code of Conduct and only post thumbnails http://wiki.archlinux.org/index.php/Cod … s_and_code

seth · 2017-04-02 07:10:04

"\u0000" is wrong treatment of string termination on some side of the code but the boxes are due to (an) incomplete font(s) - which is quite common for monospace sets (urxvt using Source Code Pro doesn't even render half as many glyphs here as on your screenshot)

loqs · 2017-04-02 09:20:13

Fonts#Pan-CJK Should cover a lot of the missing glyphs in the sample.
Emoji_and_symbols for ✀.
https://www.archlinux.org/packages/?name=noto-fonts Not needed for the sample but has good glyph coverage.

seth · 2017-04-02 12:12:39

Is any of those actually of fixed width?

loqs · 2017-04-02 14:04:34

@seth no so obviously not optimal but fontconfig appears to keep matching fonts until all the glyphs are matched or it has has exhausted the available fonts.
Tested using gnome-terminal which Cerales appeared to be using in the screenshot.
Edit:
Grammar restructured first sentence.

Last edited by loqs (2017-04-02 14:06:54)

seth · 2017-04-02 14:28:11

This is luckily controllable
https://eev.ee/blog/2015/05/20/i-stared … ack-at-me/

Arch Linux

#1 2017-04-01 23:51:32

[SOLVED] Unicode fallback font in gnome-terminal

#2 2017-04-02 00:27:31

Re: [SOLVED] Unicode fallback font in gnome-terminal

#3 2017-04-02 07:10:04

Re: [SOLVED] Unicode fallback font in gnome-terminal

#4 2017-04-02 09:20:13

Re: [SOLVED] Unicode fallback font in gnome-terminal

#5 2017-04-02 12:12:39

Re: [SOLVED] Unicode fallback font in gnome-terminal

#6 2017-04-02 14:04:34

Re: [SOLVED] Unicode fallback font in gnome-terminal

#7 2017-04-02 14:28:11

Re: [SOLVED] Unicode fallback font in gnome-terminal

Board footer