Development of the lxml library

Stefan Behnel | 1 Jun 2012 17:38

Re: xml install problems

Am 25.05.2012 04:40, schrieb William Herry:
> Hi,
> I am try to install xml on centos6.2 with command:
> pip-python install xml==2.3
> 
> it gives me this error:
> 
> Downloading/unpacking lxml==2.3
>   Running setup.py egg_info for package lxml
>     Building lxml version 2.3.
>     Building with Cython 0.14.1.

It's best to build without having Cython installed. See the docs.

>     Using build configuration of libxslt 1.1.26
>     Building against libxml2/libxslt in the following directory: /usr/lib64
> Installing collected packages: lxml
>   Running setup.py install for lxml
>     Building lxml version 2.3.
>     Building with Cython 0.14.1.
>     Using build configuration of libxslt 1.1.26
>     Building against libxml2/libxslt in the following directory: /usr/lib64
>     building 'lxml.etree' extension
>     gcc -pthread -fno-strict-aliasing -O2 -g -pipe -Wall
> -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector
> --param=ssp-buffer-size=4 -m64 -mtune=generic -D_GNU_SOURCE -fPIC -fwrapv
> -DNDEBUG -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions
> -fstack-protector --param=ssp-buffer-size=4 -m64 -mtune=generic
> -D_GNU_SOURCE -fPIC -fwrapv -fPIC -I/usr/include/libxml2
> -I/usr/include/python2.6 -c src/lxml/lxml.etree.c -o

(Continue reading)

headers

Stefan Behnel | 1 Jun 2012 17:48

Re: objectify.parse() returns lxml.etree._ElementTree instead of lxml.objectify.ObjectifiedElement

Am 30.05.2012 03:40, schrieb Roger Hoover:
> Any idea why objectify.parse() is returning an lxml.etree._ElementTree
> object while objectify.parsestring()

I assume you meant "fromstring()"?

> returns lxml.objectify.ObjectifiedElement?
> 
> I've installed lxml 2.3.4 using easy_install on Ubuntu 10.04.
> 
> from lxml import objectify
> import StringIO
> obj = objectify.parse(StringIO.StringIO("<foo><bar>1</bar></foo>"))
> print type(obj) #prints <type 'lxml.etree._ElementTree'>

Can't check right now, but I'm pretty sure there's a FAQ entry about it
(and if not, then it's certainly spelled out in the docs somewhere).

Short answer: use cases.

Stefan
_________________________________________________________________
Mailing list for the lxml Python XML toolkit - http://lxml.de/
lxml <at> lxml.de
https://mailman-mail5.webfaction.com/listinfo/lxml

headers

Stefan Behnel | 1 Jun 2012 17:46

Re: lxml.get_include() does not return system libxml paths

Am 17.05.2012 15:59, schrieb Giovanni Bajo:
> Hi Stefan,
> 
> we submitted a patch (that is currently sitting in git trunk) for distributing pxd interface files with
lxml (including the static Windows package), to simplify writing cython code that class the lxml Cython
API interface.
> 
> Unfortunately, we're not quite there yet, because lxml.get_include() still does not return the system
include path for libxml (/usr/include/libxml2 or the like), in the cases in which the system ones were
used (I think it does work in the case where libxml header files are being shipped within the lxml static
package, like on Windows; I can't verify since there is no static Windows package for 2.4 yet).
> 
> This means that each and every users of the lxml Cython API must include a build system that duplicates
lxml's one build system and finds the system libxml include path.
> 
> I was trying to get to a point where a lxml Cython API user should only call lxml.get_include() and get a list
of pxd/h directories to be used for both cythoning (pxd) and compiling (h) the extension. Do you think it
makes sense to get there?

Absolutely. get_include() should return whatever is required as include
paths on the current system.

Stefan
_________________________________________________________________
Mailing list for the lxml Python XML toolkit - http://lxml.de/
lxml <at> lxml.de
https://mailman-mail5.webfaction.com/listinfo/lxml

headers

Stefan Behnel | 1 Jun 2012 17:41

Re: gpx tostring for xml newbe

Am 20.05.2012 15:35, schrieb janwillem:
> I wanted to do some analyzing of Garmin gpx track and waypoint files. So
> I thought of diving into lxml and start with pretty printing a garmin
> file. Garmin writes all info on a single line which is not pretty. When
> split into lines a waypoint looks like:
> <wpt lat="52.151006" lon="15.373755">
> <ele>14.742697</ele>
> <time>2012-05-19T20:23:15Z</time>
> <name>Gazon</name>
> <sym>Park</sym>
> <extensions>
> <wptx1:WaypointExtension>
> <wptx1:Samples>3</wptx1:Samples>
> </wptx1:WaypointExtension>
> </extensions>
> </wpt>
> 
> when I do:
> 
> wpt = '{%s}wpt' % xmlns
> 
>     waypoints = root.findall(wpt)
> 
> for point in waypoints:
> 
> print point.get('lon'), point.get('lat')
> 
>         print etree.tostring(point, pretty_print=True, with_tail=False)
> 
> I get a lot of info from the beginning of the file between "<wpt" and

(Continue reading)

headers

William Herry | 3 Jun 2012 04:22

Re: xml install problems

I messed up my system, maybe some lib problem(I don't know but it is messed up), this problem doesn't exist on other CentOS, so, I just ignore it

Thanks

On Fri, Jun 1, 2012 at 11:38 PM, Stefan Behnel <stefan_ml <at> behnel.de> wrote:

Am 25.05.2012 04:40, schrieb William Herry:
> Hi,
> I am try to install xml on centos6.2 with command:
> pip-python install xml==2.3
>
> it gives me this error:
>
> Downloading/unpacking lxml==2.3
> Running setup.py egg_info for package lxml
> Building lxml version 2.3.
> Building with Cython 0.14.1.

It's best to build without having Cython installed. See the docs.

> Using build configuration of libxslt 1.1.26
> Building against libxml2/libxslt in the following directory: /usr/lib64
> Installing collected packages: lxml
> Running setup.py install for lxml
> Building lxml version 2.3.
> Building with Cython 0.14.1.
> Using build configuration of libxslt 1.1.26
> Building against libxml2/libxslt in the following directory: /usr/lib64
> building 'lxml.etree' extension
> gcc -pthread -fno-strict-aliasing -O2 -g -pipe -Wall
> -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector
> --param=ssp-buffer-size=4 -m64 -mtune=generic -D_GNU_SOURCE -fPIC -fwrapv
> -DNDEBUG -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions
> -fstack-protector --param=ssp-buffer-size=4 -m64 -mtune=generic
> -D_GNU_SOURCE -fPIC -fwrapv -fPIC -I/usr/include/libxml2
> -I/usr/include/python2.6 -c src/lxml/lxml.etree.c -o
> build/temp.linux-x86_64-2.6/src/lxml/lxml.etree.o -w
> {standard input}: Assembler messages:
> {standard input}:150508: Warning: end of file not at end of a line;
> newline inserted
> gcc: Internal error: Killed (program cc1)
> Please submit a full bug report.
> See <http://bugzilla.redhat.com/bugzilla> for instructions.

No idea what's wrong here, but this hints at a serious problem on your
system. Try to build other binary Python packages to see if this works
at all.

Stefan
_________________________________________________________________
Mailing list for the lxml Python XML toolkit - http://lxml.de/
lxml <at> lxml.de
https://mailman-mail5.webfaction.com/listinfo/lxml

--

William Herry
====================
WilliamHerryChina <at> Gmail.com

_________________________________________________________________
Mailing list for the lxml Python XML toolkit - http://lxml.de/
lxml <at> lxml.de
https://mailman-mail5.webfaction.com/listinfo/lxml

headers

Roger Hoover | 4 Jun 2012 03:10

Re: objectify.parse() returns lxml.etree._ElementTree instead of lxml.objectify.ObjectifiedElement

Oh, I see. I need to call obj.get_root() to the ObjectifiedElement. Thanks.

Roger

On Fri, Jun 1, 2012 at 8:48 AM, Stefan Behnel <stefan_ml <at> behnel.de> wrote:

Am 30.05.2012 03:40, schrieb Roger Hoover:
> Any idea why objectify.parse() is returning an lxml.etree._ElementTree
> object while objectify.parsestring()

I assume you meant "fromstring()"?

> returns lxml.objectify.ObjectifiedElement?
>
> I've installed lxml 2.3.4 using easy_install on Ubuntu 10.04.
>
> from lxml import objectify
> import StringIO
> obj = objectify.parse(StringIO.StringIO("<foo><bar>1</bar></foo>"))
> print type(obj) #prints <type 'lxml.etree._ElementTree'>

Can't check right now, but I'm pretty sure there's a FAQ entry about it
(and if not, then it's certainly spelled out in the docs somewhere).

Short answer: use cases.

Stefan
_________________________________________________________________
Mailing list for the lxml Python XML toolkit - http://lxml.de/
lxml <at> lxml.de
https://mailman-mail5.webfaction.com/listinfo/lxml

_________________________________________________________________
Mailing list for the lxml Python XML toolkit - http://lxml.de/
lxml <at> lxml.de
https://mailman-mail5.webfaction.com/listinfo/lxml

headers

Stefan Behnel | 6 Jun 2012 16:50

Suggestions for lxml topics at PyCon-DE ? Anyone for a code sprint?

Hi,

I gave a somewhat generic lxml talk at last year's PyCon-DE in Leipzig. In
case some people on this list are going there, is there anything more
special you'd want me to present this year? The deadline has been extended
to Mai 15th, so there's some time left to come up with good ideas.

I'm also considering to run an lxml sprint at the end of the conference.
Anyone interested in learning how to work on lxml's code base? There's
quite a number of open bugs that would lend themselves to getting your
hands dirty, be it in Cython code or Python code (e.g. lxml.html). Working
on those would be a very good way to give something back to the tool you
are using.

Stefan
_________________________________________________________________
Mailing list for the lxml Python XML toolkit - http://lxml.de/
lxml <at> lxml.de
https://mailman-mail5.webfaction.com/listinfo/lxml

headers

Andreas Maier | 7 Jun 2012 12:08

How to produce explicitly closed form of HTML tags

Hi,
I am using lxml's XSLT support to transform XML to HTML. The XSLT specifies the following xsl:output directive:

<xsl:output method="html" version="4.0" encoding="UTF-8" media-type="text/html"
doctype-public="-//W3C//DTD HTML 4.01//EN" standalone="yes"
omit-xml-declaration="yes" indent="no"/>

I serialize the output element tree to a string using the etree.tostring() function:

xslt_tree = etree.parse(xslt_url)
xslt_transform = etree.XSLT(xslt_tree.getroot())
out_tree = xslt_transform(in_root_elem)
fp.write(etree.tostring(out_tree))

This creates self-closing HTML tags, for example:

<script type="text/javascript" src="tocgen.js"/>

This hurts, because some browsers (including IE8 and FF10) do not support self-closing tags for some tags when the doctype is HTML. The script tag is a particularly nasty one because not recognizing that it is actually closed causes the whole rest of the document to be interpreted as (invalid) Javascript. But doing that with other tags may create problems as well.

What works on all browsers I tested, is the explicitly closed form:

<script type="text/javascript" src="tocgen.js"></script>

See this thread for discussion:
http://stackoverflow.com/questions/69913/why-dont-self-closing-script-tags-work

BTW, Xalan produces the explicitly closed form for the same scenario. (Just to mention it as one other data point, not that I would consider going back to Xalan - lxml is much much faster and by comparing lxml and Xalan output beyond differences such as self-closing tags I found already one difference that seems to be a Xalan bug).

-> Is there a way to get lxml's HTML serialization support to produce the explicitly closed form ?

The lxml version I am using is lxml 2.3 with libxml2 statically linked, for Python 2.6, on Windows (lxml-2.3.win32-py2.6.exe).

-> Is there a later version that has a Windows installer and libxml2 statically linked ? (Other people need to be able to set that up for my stuff to work, and this way it is real simple).

Andy

_________________________________________________________________
Mailing list for the lxml Python XML toolkit - http://lxml.de/
lxml <at> lxml.de
https://mailman-mail5.webfaction.com/listinfo/lxml

headers

Andreas Maier | 7 Jun 2012 12:47

Re: How to produce explicitly closed form of HTML tags

Hi,

-> Is there a way to get lxml's HTML serialization support to produce the explicitly closed form ?

I actually found a solution to this problem, by specifying more parameters to the etree.tostring() function:

fp.write(etree.tostring(out_tree,
      encoding="utf-8", method="html", xml_declaration=None,
      pretty_print=False, with_tail=True, standalone=None,
      doctype='<!DOCTYPE html PUBLIC "-//W3C//DTD HTML 4.01//EN">'))

However, this means that the output parameters specified in the XSLT become meaningless, because they are overwritten in the Python program.

-> Is there a way to let lxml honor the output parameters specified in the XSLT ?
It seems to me that would be a good default behavior.

-> Also, is there a way to get any HTML comments in the element tree to be serialized ?
The tostring() parameter with_comments is documented to apply to the C14N output method only, and does not cause the HTML comments to be created when set to True.

Andy

_________________________________________________________________
Mailing list for the lxml Python XML toolkit - http://lxml.de/
lxml <at> lxml.de
https://mailman-mail5.webfaction.com/listinfo/lxml

headers

Simon Sapin | 7 Jun 2012 13:29

Re: How to produce explicitly closed form of HTML tags

Le 07/06/2012 12:47, Andreas Maier a écrit :
> I actually found a solution to this problem, by specifying more
> parameters to the etree.tostring() function:
>
>    fp.write(etree.tostring(... method="html"))

Alternatively, html5lib can serialize lxml trees:

http://code.google.com/p/html5lib/wiki/UserDocumentation#Serialization_of_Streams

https://github.com/Kozea/docutils-html5-writer/blob/master/docutils_html5/__init__.py#L73

Regards,
--

-- 
Simon Sapin

_________________________________________________________________
Mailing list for the lxml Python XML toolkit - http://lxml.de/
lxml <at> lxml.de
https://mailman-mail5.webfaction.com/listinfo/lxml

13	June 2013
56	May 2013
31	April 2013
25	March 2013
47	February 2013
6	January 2013
28	December 2012
61	November 2012
33	October 2012
54	September 2012
41	August 2012
25	July 2012
48	June 2012
28	May 2012
38	April 2012
19	March 2012
30	February 2012
46	January 2012
29	December 2011
33	November 2011
44	October 2011
29	September 2011
26	August 2011
28	July 2011
44	June 2011
42	May 2011
45	April 2011
46	March 2011
82	February 2011
8	January 2011
27	December 2010
36	November 2010
39	October 2010
68	September 2010
29	August 2010
80	July 2010
51	June 2010
72	May 2010
38	April 2010
83	March 2010
48	February 2010
81	January 2010
73	December 2009
88	November 2009
58	October 2009
60	September 2009
83	August 2009
100	July 2009
132	June 2009
51	May 2009
45	April 2009
54	March 2009
58	February 2009
68	January 2009
45	December 2008
104	November 2008
43	October 2008
42	September 2008
101	August 2008
136	July 2008
120	June 2008
110	May 2008
66	April 2008
75	March 2008
165	February 2008
75	January 2008
43	December 2007
30	November 2007
100	October 2007
111	September 2007
84	August 2007
146	July 2007
175	June 2007
95	May 2007
76	April 2007
55	March 2007
94	February 2007
20	January 2007
36	December 2006
63	November 2006
84	October 2006
121	September 2006
117	August 2006
61	July 2006
286	June 2006
281	May 2006
42	April 2006
136	March 2006
32	February 2006
23	January 2006
96	December 2005
263	November 2005
50	October 2005
41	September 2005
126	August 2005
29	July 2005
59	June 2005
78	May 2005
48	April 2005
22	January 2005
5	December 2004
28	November 2004
19	October 2004
6	September 2004

Mon	Tue	Wed	Thu	Fri	Sat	Sun

				1	2	3
4	5	6	7	8	9	10
11	12	13	14	15	16	17
18	19	20	21	22	23	24
25	26	27	28	29	30