Board index PERL

Read buffer size for XML::Twig

Read buffer size for XML::Twig

Post by Jase Well » Sun, 06 Aug 2006 08:57:08


I'm using XML::Twig to process a large XML file, and it's working fine.
That is, except for a particular node whose text is quite long -- the
data between the start/end tags is around 50 MB or so.

It seems to take a looong time to read, so I added a char_handler to
see what was happening. My char_handler subroutine tells me it's
receiving at most 1024 bytes at a time. Is there some option to change
the buffer size XML::Twig (or XML::Parser) uses to read the source
file? I've looked around, but no luck yet.

-j
 
 
 
Top

Read buffer size for XML::Twig

Post by miro » Tue, 08 Aug 2006 06:20:52


The size of the buffer is indeed not set by XML::Twig. It could be in
XML::Parser or
directly in expat.

I would be very interested if you find this information.

Thank you.

--
mirod

 
 
 
Top

1. Bug found, was: read(fd, buf, size) reads more than the given buffer size

2. read(fd, buf, size) reads more than the given buffer size

3. Question regarding XML::Twig and parsing subelements of an XML-Tree

4. How to know the buffer size and increase buffer size in c++

5. twig requires 5.004, I am using Windows v5.6.1, which twig do I need

6. Optimal Buffer Size To Read A File

7. How to read a stream into a buffer of non-fixed size?

8. Default buffer size BizTalk used to read stream in pipeline compon

9. Buffer size for reading symbolic links

10. Read from TCP Stream greater then buffer size

11. FMS3 - Read buffer size

12. Setting of WMP buffer size or buffer length in C# code

13. How do I modify version number in XML doc - path to pass to Twig?

14. XML::Twig exception handling

15. XML::Twig (attempted English translation)

All times are UTC
Board index