htmlparser-user Mailing List for HTML Parser

Sorry, replied without thinking.
You can apply the StringBean directly to a node list:

Parser parser = new Parser ("http://yadda.yadda");
NodeList list = parser.parse (my_spiffo_DIV_finding_filter);
Div div = list.elementAt (0);
StringBean bean = new StringBean ();
div.getChildren ().visitAllNodesWith (bean);
System.out.println (bean.getStrings ());

Derrick

Derrick Oswald wrote:

>Jesse,
>
>The job breaks down into two tasks:
>  1) get the outermost tag (your <div id="video_infobox_con"> tag) using 
>a filter you construct.
>  2) use a StringBean as a visitor on that node and it's children to 
>extract the text, like so:
>
>Parser parser = new Parser ("http://yadda.yadda");
>NodeList list = parser.parse (my_spiffo_DIV_finding_filter);
>Div div = list.elementAt (0);
>// now re-create the HTML and pass it into another Parser
>Parser parser = new Parser (div.toHtml ()); // Note: for older versions 
>you need to use setInputHtml()
>StringBean bean = new StringBean ();
>parser.visitAllNodesWith (bean);
>System.out.println (bean.getStrings ());
>
>Derrick
>
>h pq wrote:
>
>  
>
>>Hi all, I have a question when I parsered the html content.  In the 
>>html content there are many tags, if I want to get a tag text like 
>>LinkTag or TableTag , it's very easy to use the LinkRegexFilter or 
>>TagNameFilter, but if I want to get more than one tag's content , is 
>>there a filter chain ?  Maybe the example following will explain what 
>>I said directly:
>> 
>> <div id="video_infobox_con">
>>    ·add by:<span class="fcolor_03">2006.07.27 - 01:22</span><br />
>>    ·Label: 
>>                 <a href="search.do?q=%B0%CD%B6%FB%C4%E1%D1%C7%C4%E1" 
>>class="lnk_04" target=_self><u>test_a</u></a>              
>>              
>>                 <a href="search.do?q=%D7%B4%D4%AA%D0%E3" 
>>class="lnk_04" target=_self><u>test_b</u></a>              
>>              
>>                 <a href=" search.do?q=%C0%BA%C7%F2" class="lnk_04" 
>>target=_self><u>test_c</u></a>              
>>              
>>                 <a href="search.do?q=%CC%E5%D3%FD" class="lnk_04" 
>>target=_self><u>test_d</u></a>              
>>              
>> </div>
>><input type="text" id="htmlurl" name="htmlurl" value='value_test'  />
>> 
>>there are four tags such as div, span, a ,input, and  all content in 
>>these tags are what I need like 2006.07.27 - 01:22,  test_a,  test_b,  
>> test_c,  test_d and value_test
>>How should I do?  Maybe I can parser the html for 4 times to get the 
>>four tags' content, but I think it'll impact the proformance. Could 
>>you help me ? Thank you very much.
>> 
>>Best Regards
>>Jesse
>> 
>>
>>------------------------------------------------------------------------
>>
>>-------------------------------------------------------------------------
>>Take Surveys. Earn Cash. Influence the Future of IT
>>Join SourceForge.net's Techsay panel and you'll get the chance to share your
>>opinions on IT & business topics through brief surveys -- and earn cash
>>http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV
>>
>>------------------------------------------------------------------------
>>
>>_______________________________________________
>>Htmlparser-user mailing list
>>Htm...@li...
>>https://lists.sourceforge.net/lists/listinfo/htmlparser-user
>> 
>>
>>    
>>
>
>
>-------------------------------------------------------------------------
>Take Surveys. Earn Cash. Influence the Future of IT
>Join SourceForge.net's Techsay panel and you'll get the chance to share your
>opinions on IT & business topics through brief surveys -- and earn cash
>http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV
>_______________________________________________
>Htmlparser-user mailing list
>Htm...@li...
>https://lists.sourceforge.net/lists/listinfo/htmlparser-user
>
>  
>

Jesse,

The job breaks down into two tasks:
  1) get the outermost tag (your <div id="video_infobox_con"> tag) using 
a filter you construct.
  2) use a StringBean as a visitor on that node and it's children to 
extract the text, like so:

Parser parser = new Parser ("http://yadda.yadda");
NodeList list = parser.parse (my_spiffo_DIV_finding_filter);
Div div = list.elementAt (0);
// now re-create the HTML and pass it into another Parser
Parser parser = new Parser (div.toHtml ()); // Note: for older versions 
you need to use setInputHtml()
StringBean bean = new StringBean ();
parser.visitAllNodesWith (bean);
System.out.println (bean.getStrings ());

Derrick

h pq wrote:

> Hi all, I have a question when I parsered the html content.  In the 
> html content there are many tags, if I want to get a tag text like 
> LinkTag or TableTag , it's very easy to use the LinkRegexFilter or 
> TagNameFilter, but if I want to get more than one tag's content , is 
> there a filter chain ?  Maybe the example following will explain what 
> I said directly:
>  
>  <div id="video_infobox_con">
>     ·add by:<span class="fcolor_03">2006.07.27 - 01:22</span><br />
>     ·Label: 
>                  <a href="search.do?q=%B0%CD%B6%FB%C4%E1%D1%C7%C4%E1" 
> class="lnk_04" target=_self><u>test_a</u></a>              
>               
>                  <a href="search.do?q=%D7%B4%D4%AA%D0%E3" 
> class="lnk_04" target=_self><u>test_b</u></a>              
>               
>                  <a href=" search.do?q=%C0%BA%C7%F2" class="lnk_04" 
> target=_self><u>test_c</u></a>              
>               
>                  <a href="search.do?q=%CC%E5%D3%FD" class="lnk_04" 
> target=_self><u>test_d</u></a>              
>               
>  </div>
> <input type="text" id="htmlurl" name="htmlurl" value='value_test'  />
>  
> there are four tags such as div, span, a ,input, and  all content in 
> these tags are what I need like 2006.07.27 - 01:22,  test_a,  test_b,  
>  test_c,  test_d and value_test
> How should I do?  Maybe I can parser the html for 4 times to get the 
> four tags' content, but I think it'll impact the proformance. Could 
> you help me ? Thank you very much.
>  
> Best Regards
> Jesse
>  
>
>------------------------------------------------------------------------
>
>-------------------------------------------------------------------------
>Take Surveys. Earn Cash. Influence the Future of IT
>Join SourceForge.net's Techsay panel and you'll get the chance to share your
>opinions on IT & business topics through brief surveys -- and earn cash
>http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV
>
>------------------------------------------------------------------------
>
>_______________________________________________
>Htmlparser-user mailing list
>Htm...@li...
>https://lists.sourceforge.net/lists/listinfo/htmlparser-user
>  
>

Hi all, I have a question when I parsered the html content.  In the html
content there are many tags, if I want to get a tag text like LinkTag or
TableTag , it's very easy to use the LinkRegexFilter or TagNameFilter, but
if I want to get more than one tag's content , is there a filter chain ?
Maybe the example following will explain what I said directly:

 <div id=3D"video_infobox_con">
    =B7add by:<span class=3D"fcolor_03">2006.07.27 - 01:22</span><br />
    =B7Label:
                 <a href=3D"search.do?q=3D%B0%CD%B6%FB%C4%E1%D1%C7%C4%E1"
class=3D"lnk_04" target=3D_self><u>test_a</u></a>

                 <a href=3D"search.do?q=3D%D7%B4%D4%AA%D0%E3" class=3D"lnk_=
04"
target=3D_self><u>test_b</u></a>

                 <a href=3D"search.do?q=3D%C0%BA%C7%F2" class=3D"lnk_04"
target=3D_self><u>test_c</u></a>

                 <a href=3D"search.do?q=3D%CC%E5%D3%FD" class=3D"lnk_04"
target=3D_self><u>test_d</u></a>

 </div>
<input type=3D"text" id=3D"htmlurl" name=3D"htmlurl" value=3D'value_test'  =
/>

there are four tags such as div, span, a ,input, and  all content in these
tags are what I need like 2006.07.27 - 01:22,  test_a,  test_b,   test_c,
 test_d and value_test
How should I do?  Maybe I can parser the html for 4 times to get the four
tags' content, but I think it'll impact the proformance. Could you help me =
?
Thank you very much.

Best Regards
Jesse

Kavorka,

Maybe if you just want to remove the whole link, use something like:
   getParent ().getChildren ().remove (this);
in the doSemanticAction() override of your custom LinkTag class.
That will remove the current link tag from the enclosing parent tag by 
altering the children list.

Derrick

kavorka wrote:

> Hi Oswald,
> Yes i want to remove text within <a></a>. i'll try to do what you have 
> said, but 
> i'm a newbie java coder i didnt understand what you have said clearly. 
> I tried to override
> linkTAg to not to take text <a></a> now myLinkTag doesnt find links. 
> but now how can i take
> text other that <a></a>.
> if i ask to much, i'm sorry.
> thanks a lot
> murat
>
>  
> On 7/29/06, *Derrick Oswald* <Der...@ro... 
> <mailto:Der...@ro...>> wrote:
>
>     Murat,
>
>     I'm not sure what you mean by 'pure' text.
>     The stringextractor program uses the StringBean under the hood.
>     It only collects text which would be presented in a browser - or at
>     least it's supposed to.
>     The stringextractor program has an option (-links) to output the links
>     within angle brackets. Make sure this is not used.
>     If you want to remove text within <a></a> pairs you will need to
>     override the default LinkTag to not do this and register it with the
>     PrototypicalNodeFactory.
>
>     Derrick
>
>     kavorka wrote:
>
>     > Hi Oswald,
>     > I have another question. In HTMLPARSER, is it possible to
>     extract only
>     > the text in the webpage. In the stringextractor program, it extract
>     > also link text in the page, i want to extract "pure" text. can i
>     do it?
>     > thanks
>     > Murat
>     >
>
>
>     -------------------------------------------------------------------------
>     Take Surveys. Earn Cash. Influence the Future of IT
>     Join SourceForge.net's Techsay panel and you'll get the chance to
>     share your
>     opinions on IT & business topics through brief surveys -- and earn
>     cash
>     http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV
>     <http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV>
>     _______________________________________________
>     Htmlparser-user mailing list
>     Htm...@li...
>     <mailto:Htm...@li...>
>     https://lists.sourceforge.net/lists/listinfo/htmlparser-user
>
>
>------------------------------------------------------------------------
>
>-------------------------------------------------------------------------
>Take Surveys. Earn Cash. Influence the Future of IT
>Join SourceForge.net's Techsay panel and you'll get the chance to share your
>opinions on IT & business topics through brief surveys -- and earn cash
>http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV
>
>------------------------------------------------------------------------
>
>_______________________________________________
>Htmlparser-user mailing list
>Htm...@li...
>https://lists.sourceforge.net/lists/listinfo/htmlparser-user
>  
>

Hi Oswald,
Yes i want to remove text within <a></a>. i'll try to do what you have said,
but
i'm a newbie java coder i didnt understand what you have said clearly. I
tried to override
linkTAg to not to take text <a></a> now myLinkTag doesnt find links. but now
how can i take
text other that <a></a>.
if i ask to much, i'm sorry.
thanks a lot
murat


On 7/29/06, Derrick Oswald <Der...@ro...> wrote:
>
> Murat,
>
> I'm not sure what you mean by 'pure' text.
> The stringextractor program uses the StringBean under the hood.
> It only collects text which would be presented in a browser - or at
> least it's supposed to.
> The stringextractor program has an option (-links) to output the links
> within angle brackets. Make sure this is not used.
> If you want to remove text within <a></a> pairs you will need to
> override the default LinkTag to not do this and register it with the
> PrototypicalNodeFactory.
>
> Derrick
>
> kavorka wrote:
>
> > Hi Oswald,
> > I have another question. In HTMLPARSER, is it possible to extract only
> > the text in the webpage. In the stringextractor program, it extract
> > also link text in the page, i want to extract "pure" text. can i do it?
> > thanks
> > Murat
> >
>
>
> -------------------------------------------------------------------------
> Take Surveys. Earn Cash. Influence the Future of IT
> Join SourceForge.net's Techsay panel and you'll get the chance to share
> your
> opinions on IT & business topics through brief surveys -- and earn cash
> http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV
> _______________________________________________
> Htmlparser-user mailing list
> Htm...@li...
> https://lists.sourceforge.net/lists/listinfo/htmlparser-user
>

Eugeny,

Perhaps the web page is broken and has characters that can't be encoded 
by the encoding specified in the HTTP header or META tag.
Or perhaps those are lying and the real encoding is something else.
What does it look like in your browser? What encoding is it using to 
interpret it?
Use parser.setEncoding ("XXXXX"); to set the encoding before beginning 
the parse.

Derrick

Eugeny N Dzhurinsky wrote:

>Hello!
>I'm trying to parse this page and extract all links there: 
>http://www.vu.lt/lt/naujienos/337/
>
>for some reason the link to PDF file looks like: 
>http://www.vu.lt/site_files/InfS/Naujienos/istorik??%20dienos.pdf
>
>which is wrong. It seems like some wrong charset was used?
>
>Here is part of my code which does the parsing:
>
>public LinkedList parseDocument(InputStream document, String encoding) {
>    try {
>	Lexer lexer = new Lexer(new Page(document, encoding));
>	String href;
>	try {
>	    lexer.reset();
>	    if (banner != null)
>		validateBanner(lexer);
>	    lexer.reset();
>	    Parser parser = new Parser(lexer);
>	    NodeList list = null;
>	    try {
>		list = parser
>			.extractAllNodesThatMatch(new InterestedTagsFilter());
>	    } catch (EncodingChangeException e) {
>		log.warn(e);
>		lexer.reset();
>		lexer.getPage().setEncoding(parser.getEncoding());
>		list = parser
>			.extractAllNodesThatMatch(new InterestedTagsFilter());
>	    }
>	    for (SimpleNodeIterator it = list.elements(); it.hasMoreNodes();) {
>		TagNode node = (TagNode) it.nextNode();
>		href = null;
>		if (LinkTag.class.equals(node.getClass())
>			&& validateLink((LinkTag) node)) {
>		    href = ((LinkTag) node).getLink();
>		} else if (ImageTag.class.equals(node.getClass())
>			|| FrameTag.class.equals(node.getClass())) {
>		    href = node.getAttribute("src");
>		} else if (TitleTag.class.equals(node.getClass())) {
>		    title = ((TitleTag) node).getTitle();
>		} else if (BaseHrefTag.class.equals(node.getClass())) {
>		    try {
>			baseTag = getBaseURL(new URI(((BaseHrefTag) node)
>				.getBaseUrl(), false));
>		    } catch (URIException e2) {
>		    }
>		} else if (MetaTag.class.equals(node.getClass())
>			&& "refresh".equalsIgnoreCase(((MetaTag) node)
>				.getHttpEquiv())) {
>		    String URL = ((MetaTag) node).getMetaContent();
>		    if (URL != null && URL.length() > 0) {
>			String arr[] = URL.split("URL=");
>			if (arr != null && arr.length == 2)
>			    href = arr[1];
>		    }
>		}
>		if (href != null && href.length() > 0) {
>		    if (log.isDebugEnabled())
>------->		log.debug(href);		<-----------
>		    results.add(getURL(StringEscapeUtils
>			    .unescapeHtml(getEscapedURL(href.trim()))));
>		}
>	    }
>	    this.encoding = parser.getEncoding();
>	    if (log.isDebugEnabled())
>		log.debug(this.encoding);
>	} catch (ParserException e1) {
>	    log.error(e1, e1);
>	}
>    } catch (UnsupportedEncodingException e) {
>	log.error(e, e);
>    }
>    return results;
>}
>
>And on marked line application logs
>/site_files/InfS/Naujienos/istorik??%20dienos.pdf
>
>what could be wrong there?
>
>  
>

Xue-Feng,

There are many examples of collecting the parsed nodes in a nodelist, 
modify them and print the list.
Something like this should work.

NodeList list = parser.parse (null);
TextNodes text = list.extractAllNodesThatMatch (new NodeClassFilter 
(TextNode.class));
// modify the text items in the text list
System.out.println (list.toHtml ());

Derrick

Xue-Feng Yang wrote:

>I am trying to modify for the TextNodes in a lexer by 
>TextNode.setText(String). Then I tried to print the
>lexer by
>
> Page toPage=lexer.getPage();
> String toString=toPage.getText();
> System.out.println(toString);
>
>The page was unchanged.
> 
>Does any one have idea how to modify a lexer or simply
>a html page?
>
>Thanks,
>
>  
>

Murat,

I'm not sure what you mean by 'pure' text.
The stringextractor program uses the StringBean under the hood.
It only collects text which would be presented in a browser - or at 
least it's supposed to.
The stringextractor program has an option (-links) to output the links 
within angle brackets. Make sure this is not used.
If you want to remove text within <a></a> pairs you will need to 
override the default LinkTag to not do this and register it with the 
PrototypicalNodeFactory.

Derrick

kavorka wrote:

> Hi Oswald,
> I have another question. In HTMLPARSER, is it possible to extract only 
> the text in the webpage. In the stringextractor program, it extract 
> also link text in the page, i want to extract "pure" text. can i do it?
> thanks
> Murat
>

Hello, I'm trying to parse page 
http://www.vu.lt/lt/naujienos/337/

but HtmlParser fails with this error:

ERROR org.htmlparser.util.EncodingChangeException: character mismatch (new: ?
[0x2013] != old:  [0xe2?]) for encoding change from ISO-8859-1 to UTF-8 at
character offset 218
[junit] org.htmlparser.util.EncodingChangeException: character mismatch
(new: ? [0x2013] != old:  [0xe2?]) for encoding change from ISO-8859-1 to
UTF-8 at character offset 218
[junit]     at
org.htmlparser.lexer.InputStreamSource.setEncoding(InputStreamSource.java:280)
[junit]     at
org.htmlparser.lexer.Page.setEncoding(Page.java:865)
[junit]     at
org.htmlparser.tags.MetaTag.doSemanticAction(MetaTag.java:150)
[junit]     at
org.htmlparser.scanners.TagScanner.scan(TagScanner.java:69)
[junit]     at
org.htmlparser.scanners.CompositeTagScanner.scan(CompositeTagScanner.java:160)
[junit]     at
org.htmlparser.util.IteratorImpl.nextNode(IteratorImpl.java:92)
[junit]     at
org.htmlparser.Parser.extractAllNodesThatMatch(Parser.java:768)

at this line:

Lexer lexer = new Lexer(new Page(document, encoding));
Parser parser = new Parser(lexer);
---->NodeList list = parser.extractAllNodesThatMatch(new InterestedTagsFilter());<----

I don't know the document encoding initially, and thus it's null.

Could somebody please advice?

-- 
Eugene N Dzhurinsky

Hello!
I'm trying to parse this page and extract all links there: 
http://www.vu.lt/lt/naujienos/337/

for some reason the link to PDF file looks like: 
http://www.vu.lt/site_files/InfS/Naujienos/istorik??%20dienos.pdf

which is wrong. It seems like some wrong charset was used?

Here is part of my code which does the parsing:

public LinkedList parseDocument(InputStream document, String encoding) {
    try {
	Lexer lexer = new Lexer(new Page(document, encoding));
	String href;
	try {
	    lexer.reset();
	    if (banner != null)
		validateBanner(lexer);
	    lexer.reset();
	    Parser parser = new Parser(lexer);
	    NodeList list = null;
	    try {
		list = parser
			.extractAllNodesThatMatch(new InterestedTagsFilter());
	    } catch (EncodingChangeException e) {
		log.warn(e);
		lexer.reset();
		lexer.getPage().setEncoding(parser.getEncoding());
		list = parser
			.extractAllNodesThatMatch(new InterestedTagsFilter());
	    }
	    for (SimpleNodeIterator it = list.elements(); it.hasMoreNodes();) {
		TagNode node = (TagNode) it.nextNode();
		href = null;
		if (LinkTag.class.equals(node.getClass())
			&& validateLink((LinkTag) node)) {
		    href = ((LinkTag) node).getLink();
		} else if (ImageTag.class.equals(node.getClass())
			|| FrameTag.class.equals(node.getClass())) {
		    href = node.getAttribute("src");
		} else if (TitleTag.class.equals(node.getClass())) {
		    title = ((TitleTag) node).getTitle();
		} else if (BaseHrefTag.class.equals(node.getClass())) {
		    try {
			baseTag = getBaseURL(new URI(((BaseHrefTag) node)
				.getBaseUrl(), false));
		    } catch (URIException e2) {
		    }
		} else if (MetaTag.class.equals(node.getClass())
			&& "refresh".equalsIgnoreCase(((MetaTag) node)
				.getHttpEquiv())) {
		    String URL = ((MetaTag) node).getMetaContent();
		    if (URL != null && URL.length() > 0) {
			String arr[] = URL.split("URL=");
			if (arr != null && arr.length == 2)
			    href = arr[1];
		    }
		}
		if (href != null && href.length() > 0) {
		    if (log.isDebugEnabled())
------->		log.debug(href);		<-----------
		    results.add(getURL(StringEscapeUtils
			    .unescapeHtml(getEscapedURL(href.trim()))));
		}
	    }
	    this.encoding = parser.getEncoding();
	    if (log.isDebugEnabled())
		log.debug(this.encoding);
	} catch (ParserException e1) {
	    log.error(e1, e1);
	}
    } catch (UnsupportedEncodingException e) {
	log.error(e, e);
    }
    return results;
}

And on marked line application logs
/site_files/InfS/Naujienos/istorik??%20dienos.pdf

what could be wrong there?

-- 
Eugene N Dzhurinsky

I am trying to modify for the TextNodes in a lexer by 

TextNode.setText(String). Then I tried to print the
lexer by

 Page toPage=lexer.getPage();
 String toString=toPage.getText();
 System.out.println(toString);

The page was unchanged.
 

__________________________________________________
Do You Yahoo!?
Tired of spam?  Yahoo! Mail has the best spam protection around 
http://mail.yahoo.com 

Hi Oswald,
I have another question. In HTMLPARSER, is it possible to extract only the
text in the webpage. In the stringextractor program, it extract also link
text in the page, i want to extract "pure" text. can i do it?
thanks
Murat


On 7/25/06, kavorka <the...@gm...> wrote:
>
>  Hi Oswald,
>
> Thanks a lot for your help.
>
> Murat
>
>
>  On 7/24/06, Derrick Oswald <Der...@ro...> wrote:
> >
> > Kavorka,
> >
> > This should give you the meta tag, from which you can get the
> > information you want:
> >
> > NodeList nodes = parser.parse (null);
> > NodeList metas = nodes.extractAllNodesThatMatch (new TagNameFilter
> > ("META"));
> > MetaTag meta = (MetaTag)metas.elementAt (0);
> > System.out.println (meta);
> >
> > Derrick
> >
> > kavorka wrote:
> >
> > > Hi all,
> > > I'm new to HTML-parser. I used sample programs to understand how can i
> > > find the meta data of the page but i could't use it. Do you have any
> > > code samples that finds meta data of the page using HTMLparser.
> > > Thank you
> > > best regards
> > >
> >
> >
> >
> > -------------------------------------------------------------------------
> > Take Surveys. Earn Cash. Influence the Future of IT
> > Join SourceForge.net's Techsay panel and you'll get the chance to share
> > your
> > opinions on IT & business topics through brief surveys -- and earn cash
> > http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV
> >
> > _______________________________________________
> > Htmlparser-user mailing list
> > Htm...@li...
> > https://lists.sourceforge.net/lists/listinfo/htmlparser-user
> >
>
>

I am trying to modify for the TextNodes in a lexer by 
TextNode.setText(String). Then I tried to print the
lexer by

 Page toPage=lexer.getPage();
 String toString=toPage.getText();
 System.out.println(toString);

The page was unchanged.
 
Does any one have idea how to modify a lexer or simply
a html page?

Thanks,

Xue-Feng

__________________________________________________
Do You Yahoo!?
Tired of spam?  Yahoo! Mail has the best spam protection around 
http://mail.yahoo.com 

Hi Oswald,

Thanks a lot for your help.

Murat


On 7/24/06, Derrick Oswald <Der...@ro...> wrote:
>
> Kavorka,
>
> This should give you the meta tag, from which you can get the
> information you want:
>
> NodeList nodes = parser.parse (null);
> NodeList metas = nodes.extractAllNodesThatMatch (new TagNameFilter
> ("META"));
> MetaTag meta = (MetaTag)metas.elementAt (0);
> System.out.println (meta);
>
> Derrick
>
> kavorka wrote:
>
> > Hi all,
> > I'm new to HTML-parser. I used sample programs to understand how can i
> > find the meta data of the page but i could't use it. Do you have any
> > code samples that finds meta data of the page using HTMLparser.
> > Thank you
> > best regards
> >
>
>
> -------------------------------------------------------------------------
> Take Surveys. Earn Cash. Influence the Future of IT
> Join SourceForge.net's Techsay panel and you'll get the chance to share
> your
> opinions on IT & business topics through brief surveys -- and earn cash
> http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV
> _______________________________________________
> Htmlparser-user mailing list
> Htm...@li...
> https://lists.sourceforge.net/lists/listinfo/htmlparser-user
>

Kavorka,

This should give you the meta tag, from which you can get the 
information you want:

NodeList nodes = parser.parse (null);
NodeList metas = nodes.extractAllNodesThatMatch (new TagNameFilter 
("META"));
MetaTag meta = (MetaTag)metas.elementAt (0);
System.out.println (meta);

Derrick

kavorka wrote:

> Hi all,
> I'm new to HTML-parser. I used sample programs to understand how can i 
> find the meta data of the page but i could't use it. Do you have any 
> code samples that finds meta data of the page using HTMLparser.
> Thank you
> best regards
>

Eigeny,

In general, you probably want to look at the filter package.
Try running the filterbuilder application (startup script is in the bin 
directory) and read the help and tutorial.
Using this application you can create a Java program that selects only 
the 'sometext' you want.

Derrick

Eugeny N Dzhurinsky wrote:

>Hello!
>I need to search for HTML code in a page, for instance the code to search
>looks like this:
>
><div class="someclass"><a href="somelocation" ><img src="image/here"
>border="0"></a></div><span style="style2">sometext</span>
>
>This code could be placed as single line or formatted somehow, containing one
>or more linebreaks.
>
>I need also to track situation while this code is commented out, or placed
>outside <body> section.
>
>For now I created a Lexer instance for document and for this code, comparing
>them token by token, but may be there is some better way?
>
>  
>

HTMLParser is usually capable of parsing just an HTML fragment.

Parser.setInputHTML("html") and then Parser.parse(null).

Ian

On 7/14/06, Dennis Gesker <ge...@al...> wrote:
> Since it was just a string I added html and body tags and it seems I'm
> on my way.
>
> str = "<head><body> + str + "</head><;body>";
>
> --Dennis
>
> Dennis Gesker wrote:
> > I would like to parse a portion of html that I have in a buffer
> > (String), that is to say not a complete page. The string contains an
> > html table only.
> >
> > Could someone point to or provide some sample code for how to parse just
> > a fragment of html?
> >
> > Dennis
> >
> >
> >
>
> --
> Dennis R. Gesker
> email: de...@al...
> Key Id: 0xEFA10A51
>
>
>
> -------------------------------------------------------------------------
> Using Tomcat but need to do more? Need to support web services, security?
> Get stuff done quickly with pre-integrated technology to make your job easier
> Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
> http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642
> _______________________________________________
> Htmlparser-user mailing list
> Htm...@li...
> https://lists.sourceforge.net/lists/listinfo/htmlparser-user
>

Hi all,
I'm new to HTML-parser. I used sample programs to understand how can i find
the meta data of the page but i could't use it. Do you have any code samples
that finds meta data of the page using HTMLparser.
Thank you
best regards

Hello!
I need to search for HTML code in a page, for instance the code to search
looks like this:

<div class="someclass"><a href="somelocation" ><img src="image/here"
border="0"></a></div><span style="style2">sometext</span>

This code could be placed as single line or formatted somehow, containing one
or more linebreaks.

I need also to track situation while this code is commented out, or placed
outside <body> section.

For now I created a Lexer instance for document and for this code, comparing
them token by token, but may be there is some better way?

-- 
Eugene N Dzhurinsky

Since it was just a string I added html and body tags and it seems I'm 
on my way.

str = "<head><body> + str + "</head><;body>";

--Dennis

Dennis Gesker wrote:
> I would like to parse a portion of html that I have in a buffer 
> (String), that is to say not a complete page. The string contains an 
> html table only.
>
> Could someone point to or provide some sample code for how to parse just 
> a fragment of html?
>
> Dennis
>
>
>   

-- 
Dennis R. Gesker
email: de...@al...
Key Id: 0xEFA10A51

I would like to parse a portion of html that I have in a buffer 
(String), that is to say not a complete page. The string contains an 
html table only.

Could someone point to or provide some sample code for how to parse just 
a fragment of html?

Dennis


-- 
Dennis R. Gesker
email: de...@al...
Key Id: 0xEFA10A51

This should give you the "Content":

NodeList nodes = parser.parse (null);
NodeList metas = nodes.extractAllNodesThatMatch (new TagNameFilter 
("META"));
System.out.println (metas.elementAt (0).getMetaContent ());

vasantha reddy wrote:

> Hi,
>  
>                     I am using HTML parser in my project.The HTML 
> parser doesn't give the contents of meta tag as its output.I need the 
> content of the meta tag.Is there any method that I can use to get the 
> content of a particular tag by giving the tag name as input?
>
> Thank you,
> Regards,
> Vasantha
>
>