htmlparser-user Mailing List for HTML Parser

Can you give a copy of the file that shows this problem?

On 8/25/06, Srinivas N <sn...@os...> wrote:
>
>
>
> hi , all
>
> Please help me it is very urgent
>
>
> I have an html content which consists of 48 input tags in a form tag when
> formTag.getFormInputs() is called it returned me 48 counts consisting of
> many table tags inside the form tag , but when the same content is paced
> including the formtag in table tag the parsed parsed upto 14 input tags and
> could not return the count of 48 tags which is expected
>
> please let me know the problem with the parser of the way of representation
> of table tag above the form tag
>
> with regards
> Srinivas
>
>
>
>
>
>
>
> -------------------------------------------------------------------------
> Using Tomcat but need to do more? Need to support web services, security?
> Get stuff done quickly with pre-integrated technology to make your job
> easier
> Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
> http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642
>
> _______________________________________________
> Htmlparser-user mailing list
> Htm...@li...
> https://lists.sourceforge.net/lists/listinfo/htmlparser-user
>
>
>

On Fri, Aug 25, 2006 at 09:56:48AM +0100, Ian Macfarlane wrote:
> If it's guaranteed to be valid XML, I'd use an XML parser instead.
> Java has one built in, or look into Xerces.

The thing is I will get the document as input, and I don't know which of
formats - HTML, XHTML or XML - it will be, so I'm looking for common way to
build DOM for these formats.

-- 
Eugene N Dzhurinsky

hi , all

Please help me it is very urgent


I have an html content which consists of 48 input tags in a form tag =
when formTag.getFormInputs() is called it returned me 48 counts =
consisting of many table tags inside the form tag , but when the same =
content is paced including the formtag in table tag the parsed parsed =
upto 14 input tags and could not return the count of 48 tags which is =
expected

please let me know the problem with the parser of the way of =
representation of table tag above the form tag

with regards
Srinivas






   =20

If it's guaranteed to be valid XML, I'd use an XML parser instead.
Java has one built in, or look into Xerces.

Ian

On 8/23/06, Eugeny N Dzhurinsky <bo...@re...> wrote:
> Is it possible to parse XML documents as well as XHTML documents with
> htmlparser?
>
> --
> Eugene N Dzhurinsky
>
> -------------------------------------------------------------------------
> Using Tomcat but need to do more? Need to support web services, security?
> Get stuff done quickly with pre-integrated technology to make your job easier
> Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
> http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642
> _______________________________________________
> Htmlparser-user mailing list
> Htm...@li...
> https://lists.sourceforge.net/lists/listinfo/htmlparser-user
>

Is it possible to parse XML documents as well as XHTML documents with
htmlparser?

-- 
Eugene N Dzhurinsky

Hi,

I would be interested to hear some real user stories.  The traffic on 
this list is pretty much all problems encountered - and solutions 
provided hopefully - but there must be a whole bunch of people who are 
using it for weird and wild projects without a problem.  After all there 
are 3000 downloads a month, and it's not that hard to use is it?

So how about it?  Tell us your success story or something small or large 
you are proud of accomplishing with htmlparser.

Derrick

Jesse,

The problem may be within the HtmlUtils.registerTags.
What does this do? What tags does it register?

The div tag filter will return multiple elements with the same text as
in the case of:
<div class='A'><div class='B'>the text</div></div>
will return a list containing two items:
1) <div class='A'><div class='B'>the text</div></div>
2) <div class='B'>the text</div>
which if you pass it to string extractor will return:
the textthe text

Derrick

hpq852 wrote:

> Hi All, I encountered a very strange question. My code is very simple
> as following:
> public void doTest() throws Exception
> {
> URL url = new URL("http://www.uume.com/play_CPRz8a2si4zK");
> InputStream in = url.openStream();
> BufferedReader br = new BufferedReader(new InputStreamReader(in,
> "GB2312"));
> String line = null;
> StringBuffer sb = new StringBuffer();
> while ((line = br.readLine()) != null)
> {
> sb.append(line);
> sb.append("\n");
> }
> extractText2(sb.toString());
> }
>
> public String extractText2(String inputHtml) throws Exception
> {
> Parser parser = Parser.createParser(new
> String(inputHtml.getBytes(),"GB2312"), "GB2312");
> HtmlUtils.registerTags(parser);
> NodeFilter tagNameFilter = new TagNameFilter("div");
> NodeList nodeList = parser.extractAllNodesThatMatch(tagNameFilter);
>
> System.out.println(nodeList.toHtml());
> return null;
> }
> I just want to get all of div tags, so I used a TagNameFilter, but the
> result I got in the console is strange, it includes many repeated div
> tags with same content.
> I have tried for many times, but what I got was the same, I really
> don't know what't the reason. Could you help me please?
> Thanks and Best Regards
> Jesse
>

Hi All,  I encountered a very strange question. My code is very simple as following:

 public void doTest() throws Exception
 {
  URL url = new URL("http://www.uume.com/play_CPRz8a2si4zK");
  InputStream in = url.openStream();
  BufferedReader br = new BufferedReader(new InputStreamReader(in, "GB2312"));
  String line = null;
  StringBuffer sb = new StringBuffer();
  while ((line = br.readLine()) != null) 
  {
   sb.append(line);    
   sb.append("\n");
  }
  extractText2(sb.toString());
 }
 
 public String extractText2(String inputHtml) throws Exception
 {
  Parser parser = Parser.createParser(new String(inputHtml.getBytes(),"GB2312"), "GB2312");
  HtmlUtils.registerTags(parser);
  NodeFilter tagNameFilter = new TagNameFilter("div");
  NodeList nodeList = parser.extractAllNodesThatMatch(tagNameFilter);

  System.out.println(nodeList.toHtml());
  return null;
 }
 
I just want to get all of div tags, so I used a TagNameFilter, but the result I got in the console is strange, it includes many repeated div tags with same content.
I have tried for many times, but what I got was the same, I really don't know what't the reason. Could you help me please?

Thanks and Best Regards
Jesse

Jesse,

 From your example, you can also get all the div tags at once and filter 
on class in a secondary pass:

NodeList divs = nodelist.extractAllTagsThatMatch (new TagNameFilter 
("DIV"));
DivTag div_a = divs.extractAllTagsThatMatch (new HasAttributeFilter 
("class", "A")).element (0); // presuming there is only one
DivTag div_b = divs.extractAllTagsThatMatch (new HasAttributeFilter 
("class", "B")).element (0); // presuming there is only one

and this may be faster than searching the entire page each time.

Derrick

Ian Macfarlane wrote:

>As long as you keep the original reference to the NodeList created by
>Parser.parse, and you haven't modified that NodeList, you should be
>able to reuse it, I think.
>
>Ian
>
>On 8/3/06, Jesse Hou <hp...@gm...> wrote:
>  
>
>>Hi All,   When I'm using the htmlparser library, I suffered from a
>>difficulty. In a html there are many tags such as title, div, input, span
>>and so on. For example:
>>
>><title>this is a test </title>
>>
>>
>>//...... any other tags
>>
>><div class="A">
>>       <span class="B"><a href=" www.google.com ">google</a></span>
>></div>
>>
>>
>>//...... any other tags
>>
>><div class="C">
>>       <div class="D"><input type="text" id="E" value="msn" /></div>
>></div>
>>
>>//...... any other tags
>>
>>
>><div class="C">
>>       <div class="E"><span class="B"><input type="text" id="E" value="aol"
>>/><a href=" www.live.com ">live</a></span></div>
>></div>
>>
>>In this example maybe the whole html include many tags. if I want to get the
>>content 'this is a test',  maybe I can use a TagNameFilter, I have to parse
>>the whole html. If I want to get the content 'google' or ' www.google.com'
>>then I have to parse the whole html for the second time and if I want to get
>>'msn', 'aol', 'live' maybe I should parse the whole html for several times.
>>In this way I can get the content what I need but maybe this way will impact
>>the performance. Is there any other way to do that?  Maybe I can also use
>>OrFilter to get the Nodes but how can I identify a text match which tag? If
>>I want to store them into DB I have no idea how to do that by only once
>>parsing the html (the best performance).  I beg your help. :-)
>>
>>Thanks and Best Regards
>>
>>Jesse
>>
>  
>

As long as you keep the original reference to the NodeList created by
Parser.parse, and you haven't modified that NodeList, you should be
able to reuse it, I think.

Ian

On 8/3/06, Jesse Hou <hp...@gm...> wrote:
>
> Hi All,   When I'm using the htmlparser library, I suffered from a
> difficulty. In a html there are many tags such as title, div, input, span
> and so on. For example:
>
> <title>this is a test </title>
>
>
> //...... any other tags
>
> <div class="A">
>        <span class="B"><a href=" www.google.com ">google</a></span>
> </div>
>
>
> //...... any other tags
>
> <div class="C">
>        <div class="D"><input type="text" id="E" value="msn" /></div>
> </div>
>
> //...... any other tags
>
>
> <div class="C">
>        <div class="E"><span class="B"><input type="text" id="E" value="aol"
> /><a href=" www.live.com ">live</a></span></div>
> </div>
>
> In this example maybe the whole html include many tags. if I want to get the
> content 'this is a test',  maybe I can use a TagNameFilter, I have to parse
> the whole html. If I want to get the content 'google' or ' www.google.com'
> then I have to parse the whole html for the second time and if I want to get
> 'msn', 'aol', 'live' maybe I should parse the whole html for several times.
> In this way I can get the content what I need but maybe this way will impact
> the performance. Is there any other way to do that?  Maybe I can also use
> OrFilter to get the Nodes but how can I identify a text match which tag? If
> I want to store them into DB I have no idea how to do that by only once
> parsing the html (the best performance).  I beg your help. :-)
>
> Thanks and Best Regards
>
> Jesse
> -------------------------------------------------------------------------
> Take Surveys. Earn Cash. Influence the Future of IT
> Join SourceForge.net's Techsay panel and you'll get the chance to share your
> opinions on IT & business topics through brief surveys -- and earn cash
> http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV
>
> _______________________________________________
> Htmlparser-user mailing list
> Htm...@li...
> https://lists.sourceforge.net/lists/listinfo/htmlparser-user
>
>
>

Hi All,   When I'm using the htmlparser library, I suffered from a
difficulty. In a html there are many tags such as title, div, input,
span and so on. For example:

<title>this is a test </title>

//...... any other tags

<div class="A">
       <span class="B"><a href=" www.google.com ">google</a></span>
</div>

//...... any other tags

<div class="C">
       <div class="D"><input type="text" id="E" value="msn" /></div>
</div>

//...... any other tags

<div class="C">
       <div class="E"><span class="B"><input type="text" id="E" value="aol"
/><a href=" www.live.com ">live</a></span></div>
</div>

In this example maybe the whole html include many tags. if I want to get the
content 'this is a test',  maybe I can use a TagNameFilter, I have to parse
the whole html. If I want to get the content 'google' or 'www.google.com'
then I have to parse the whole html for the second time and if I want to get
'msn', 'aol', 'live' maybe I should parse the whole html for several times.
In this way I can get the content what I need but maybe this way will impact
the performance. Is there any other way to do that?  Maybe I can also use
OrFilter to get the Nodes but how can I identify a text match which tag? If
I want to store them into DB I have no idea how to do that by only once
parsing the html (the best performance).  I beg your help. :-)

Thanks and Best Regards

Jesse