[XeTeX] Extra trailing space in IPA font with xltxtra

[Heiko Oberdiek]

On Tue, Sep 21, 2010 at 11:26:37PM +0100, Paolo Matteucci wrote:

> ?At least something "in the neighbourhood of" \scantokens, as some tracing
> reveals:
> 
> [without xltxtra:]
> 
> {changing \cf at encoding=macro:->OT1}
> {into \cf at encoding=macro:->T3}
> {the letter a}
> {end-group character }}
> 
> [with xltxtra:]
> 
> \implementTIPAtextx #1->\scantokens {#1}\egroup
> #1<-a
> {\scantokens}
> {the letter a}
> {blank space  }
> {end-group character }}
> 
> ?but my TeXnical knowledge stops here. :-(

#1 is "a" (without blank space), \scantokens then reads
a new line "a<EOL>" and <EOL> is converted to {blank space}.

I don't know, why \scantokens is used at all -- it usually
causes more problems than it solves. But if it is being used,
then the code should take care of
* end of line, e.g. can be suppressed by \endlinechar=-1 %
* \everyeof that might not be empty.

In the meantime the problem seems to be fixed:

 *File List*
 article.cls    2007/10/19 v1.4h Standard LaTeX document class
  size10.clo    2007/10/19 v1.4h Standard LaTeX file (size option)
 xltxtra.sty    2010/09/20 v0.5e Improvements for the "XeLaTeX" format
ifluatex.sty    2010/03/01 v1.3 Provides the ifluatex switch (HO)
 ifxetex.sty    2010/09/12 v0.6 Provides ifxetex conditional
fontspec.sty    2010/08/01 v2.0c Advanced font selection for
XeLaTeX/LuaLaTeX
   expl3.sty    2010/09/14 v2020 L3 Experimental code bundle wrapper
 l3names.sty    2010/07/25 v1987 L3 Experimental Naming Scheme for TeX
Primitives
    etex.sty    1998/03/26 v2.0 eTeX basic definition package (PEB)
l3basics.sty    2010/08/04 v1992 L3 Experimental basic definitions
 l3expan.sty    2010/08/04 v1991 L3 Experimental Argument Expansion module
    l3tl.sty    2010/05/22 v1919 L3 Experimental Token Lists
l3intexpr.sty    2010/06/15 v1957 L3 Integer Expressions
 l3quark.sty    2010/03/21 v1853 L3 Experimental Quark Commands
   l3seq.sty    2010/03/29 v1879 L3 Experimental sequences and stacks
  l3toks.sty    2010/05/25 v1933 L3 Experimental Token Registers
   l3int.sty    2010/05/25 v1933 L3 Experimental Integer module
   l3prg.sty    2010/08/04 v1992 L3 Experimental control structures
 l3clist.sty    2010/08/04 v1992 L3 Experimental comma separated lists
 l3token.sty    2010/04/11 v1890 L3 Experimental token investigation and
manipulation
  l3prop.sty    2010/03/21 v1857 L3 Experimental Property Lists
   l3msg.sty    2010/03/23 v1866 L3 Experimental LaTeX Messages module
    l3io.sty    2010/05/22 v1923 L3 Experimental i/o module
  l3skip.sty    2010/05/25 v1933 L3 Experimental skip registers
   l3box.sty    2010/09/03 v2015 L3 Experimental Box module
l3keyval.sty    2010/04/11 v1890 L3 Experimental keyval processing
  l3keys.sty    2010/05/24 v1931 L3 Experimental key-value support
l3precom.sty    2010/02/09 v1793 L3 Experimental precompilation module
  l3xref.sty    2010/02/09 v1786 L3 Experimental cross referencing
  l3file.sty    2010/03/21 v1853 L3 Experimental file loading
    l3fp.sty    2010/09/14 v2021 L3 Experimental floating-point operations
l3luatex.sty    2010/07/18 v1985 L3 Experimental LuaTeX functions
    calc.sty    2007/08/22 v4.3 Infix arithmetic (KKT,FJ)
  xparse.sty    2009/11/06 v1727 Generic document command parser
 xkeyval.sty    2008/08/13 v2.6a package option processing (HA)
 xkeyval.tex    2008/08/13 v2.6a key=value parser (HA)
fontspec-patches.sty    2010/08/01 v2.0c Advanced font selection for
XeLaTeX/LuaLaTeX
fixltx2e.sty    2006/09/13 v1.1m fixes to LaTeX
 fontenc.sty
  eu1enc.def    2010/05/27 v0.1h Experimental Unicode font encodings
  eu1lmr.fd    2009/10/30 v1.6 Font defs for Latin Modern
fontspec.cfg
realscripts.sty    2010/09/20 v0.2 Access OpenType subscripts and
superscripts
metalogo.sty    2010/05/29 v0.12 Extended TeX logo macros
graphicx.sty    1999/02/16 v1.0f Enhanced LaTeX Graphics (DPC,SPQR)
graphics.sty    2009/02/05 v1.0o Standard LaTeX Graphics (DPC,SPQR)
    trig.sty    1999/03/16 v1.09 sin cos tan (DPC)
graphics.cfg    2010/04/23 v1.9 graphics configuration of TeX Live
   xetex.def    2009/11/22 v0.94 LaTeX color/graphics driver for XeTeX
(RRM/JK)
    tipa.sty    2002/08/08 TIPA version 1.1
 fontenc.sty
   t3enc.def    2001/12/31 T3 encoding
 eu1lmss.fd    2009/10/30 v1.6 Font defs for Latin Modern
  eu1enc.def    2010/05/27 v0.1h Experimental Unicode font encodings
   t3cmr.fd    2001/12/31 TIPA font definitions
 ***********

Yours sincerely
  Heiko Oberdiek