Corrupted layout/variant list on Step 3 in installer

Bug #542310 reported by Simos Xenitellis 
44
This bug affects 7 people
Affects Status Importance Assigned to Milestone
Ubuntu Translations
Fix Released
High
Unassigned
console-setup (Ubuntu)
Fix Released
Undecided
Unassigned
Lucid
Fix Released
Undecided
Unassigned
ubiquity (Ubuntu)
Invalid
High
Evan
Lucid
Invalid
High
Evan

Bug Description

Binary package hint: ubiquity

SUMMARY: While installing Ubuntu, on Step 3 we can choose a keyboard layout.
The layout names are localised by the package xkeyboard-config).
If on Step 1 we chose a language such as Russian, Greek, French,
then those layout names on Step 3 appear as in the screenshots (UTF-8 text shown as ??????).

HOW TO REPRODUCE:
1. Get either Ubuntu 10.04 Beta1 or the daily live ISO (tried lucid-desktop-i386.iso, 25-Mar-2010).
2. Start the LiveCD and go into the installer.
3. On Step 1, select the Greek language (Russian, etc work as well).
Any language that translated xkeyboard-config and the script has characters other than US ASCII).
See http://translationproject.org/domain/xkeyboard-config.html for available languages.
4. On Step 3, notice the layout names. You may select Custom and go through the layout and variant lists.
5. Instead of showing UTF-8 text, ubiquity read the names as if the encoding was US ASCII (7-bit), thus the ? character appears.

In addition, one of the screenshots below shows that layout list gets corrupted with system directories names.

Revision history for this message
Simos Xenitellis  (simosx) wrote :
Revision history for this message
Simos Xenitellis  (simosx) wrote :
Revision history for this message
Simos Xenitellis  (simosx) wrote :
Revision history for this message
Thanos Lefteris (alefteris) wrote :

Confirmed also in lucid beta 1 urn live image.

Changed in ubiquity (Ubuntu):
assignee: nobody → Colin Watson (cjwatson)
status: New → Confirmed
Revision history for this message
David Planella (dpm) wrote :

I could confirm this in Catalan (see attachment from our translators list), Greek and French. Spanish and German look ok.

Changed in ubuntu-translations:
status: New → Triaged
importance: Undecided → High
Colin Watson (cjwatson)
Changed in ubiquity (Ubuntu):
assignee: Colin Watson (cjwatson) → nobody
Revision history for this message
Simos Xenitellis  (simosx) wrote :

David, this is a encoding issue that affects all scripts that have characters other than the typical English characters.
Therefore, it should affect Spanish and German if a message has ñ or ü respectively. In the UTF-8 encoding, common Latin characters such as those found in English are stored in the same way as US-ASCII, so they are shown just fine. If Ubiquity is not prepared to read UTF-8 text, then it shows ??? for any non-US-ASCII character.

I cloned the source code of Ubiquity in an attempt to figure out what's going wrong.
I do not understand where Ubiquity locates and opens those xkeyboard-config.mo files with the translations.
The problem should be at that part of the code, and most probably this is a one-line fix.

Revision history for this message
Alkis Georgopoulos (alkisg) wrote :

Confirming that the problem still exists in today's daily-live:
  lucid-desktop-i386.iso 25-Mar-2010

Also, if I press [Guess] and manage to select a [gr] layout, I end up with a [be] layout in the installed system! Another user confirmed this, I don't know why it's happening.

Third, if I press the [Try Ubuntu] button instead of installing it, ubiquity doesn't ask me for a keyboard layout, so I can't type Greek characters on the live CD.

All the above problems are _not_ there if I select the Greek layout in gfxboot instead of ubiquity.
So I believe all those 3 problems are caused by ubiquity.

description: updated
summary: - Keyboard layout encoding problem (????) during install
+ Corrupted layout/variant list on Step 3 in installer
Revision history for this message
Simos Xenitellis  (simosx) wrote :

This is not a translation bug (according to https://wiki.ubuntu.com/Bugs/HowToTriage#Translation%20Bugs%20and%20Launchpad%20integration).

It is a ubiquity bug that has to do with not setting the correct character encoding.

Changed in ubuntu-translations:
status: Triaged → Invalid
Revision history for this message
David Planella (dpm) wrote : Re: [Bug 542310] Re: Keyboard layout encoding problem (????) during install

Hi Alkis,

Thanks for the useful feedback.

El Do 25 de 03 de 2010 a les 22:22 +0000, en/na Alkis Georgopoulos va
escriure:
> Confirming that the problem still exists in today's daily-live:
> lucid-desktop-i386.iso 25-Mar-2010
>
> Also, if I press [Guess] and manage to select a [gr] layout, I end up
> with a [be] layout in the installed system! Another user confirmed this,
> I don't know why it's happening.
>
> Third, if I press the [Try Ubuntu] button instead of installing it,
> ubiquity doesn't ask me for a keyboard layout, so I can't type Greek
> characters on the live CD.
>
> All the above problems are _not_ there if I select the Greek layout in gfxboot instead of ubiquity.
> So I believe all those 3 problems are caused by ubiquity.
>

You are describing two other issues, which although related to this bug,
should probably be considered separately.

Keeping track of multiple problems in the same report make it harder for
developers to solve the issues and keep track of the open tasks.

Therefore, may I ask you to open separate bugs for the two other issues
you were mentioning?

Thanks!

Changed in ubuntu-translations:
status: Invalid → Triaged
Revision history for this message
David Planella (dpm) wrote : Re: [Bug 542310] Re: Corrupted layout/variant list on Step 3 in installer

El Fr 26 de 03 de 2010 a les 01:01 +0000, en/na Simos Xenitellis va
escriure:
> This is not a translation bug (according to
> https://wiki.ubuntu.com/Bugs/HowToTriage#Translation%20Bugs%20and%20Launchpad%20integration).
>
> It is a ubiquity bug that has to do with not setting the correct
> character encoding.
>

That's true. However, the link above does not define an exhaustive list
of bugs that should be filed against the ubuntu-translations project,
and sometimes the decision on whether it is a valid translations bug is
a subjective one: whether the bug has an impact on localized
installations and whether the translations team wants to keep it on
their radar.

I'd still like to track this bug as a translations bug, since it affects
localized installations (they are the ones likely to be shown keyboard
variants with non-ASCII descriptions), thus I'm setting back the status
to Triaged. Thanks!

Evan (ev)
Changed in ubiquity (Ubuntu):
assignee: nobody → Evan Dandrea (ev)
importance: Undecided → High
milestone: none → ubuntu-10.04-beta-2
status: Confirmed → Triaged
Revision history for this message
Evan (ev) wrote :

This appears to be specific to ubiquity's interaction with console-setup, as debian-installer is able to display the translations without issue.

Colin Watson (cjwatson)
Changed in ubiquity (Ubuntu Lucid):
status: Triaged → Fix Committed
Revision history for this message
Simos Xenitellis  (simosx) wrote :
Revision history for this message
Evan (ev) wrote :

Fixed:

console-setup (1.34ubuntu13) lucid; urgency=low

  * Remove iconv transliteration. We don't use non-UTF-8 locales, and
    it breaks ubiquity as we haven't generated the configured locale by
    the time we hit console-setup (LP: #542310).

 -- Evan Dandrea <email address hidden> Fri, 26 Mar 2010 12:50:50 +0000

Changed in ubiquity (Ubuntu Lucid):
milestone: ubuntu-10.04-beta-2 → none
status: Fix Committed → Invalid
Changed in console-setup (Ubuntu Lucid):
status: New → Fix Released
David Planella (dpm)
Changed in ubuntu-translations:
status: Triaged → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Duplicates of this bug

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.