This browser is no longer supported.
Upgrade to Microsoft Edge to take advantage of the latest features, security updates, and technical support.
I'm trying to parse an html with basically the same tags.
Is there a way to get as output:
BTC - Bitcoin, BEP20(BSC), Bitcoin(Segwit)
ETH - ERC20, BEP20(BSC), POLYGON, ARBITRUM, AURORA, MATISEVM
USDT - OMNI,TRC20,ERC20,BEP20(BSC),HECO,POLYGON,FTM, AVAX-C ,ARBITRUM,METISEVM
QASH - ERC20
from the follow html code sample
<div data-v-326d86f4="" class="table-box">
<table data-v-326d86f4="">
<tr data-v-326d86f4="">
<td data-v-326d86f4="">BTC</td>
<td data-v-326d86f4="" class="block-chain">
<div data-v-326d86f4="" class="chain_box"><span data-v-326d86f4="" class="chain_name">Bitcoin</span> <span data-v-326d86f4=""><i data-v-326d86f4="" class="fa fa-caret-down"></i></span></div>
<div data-v-326d86f4="" class="select-list"><span data-v-326d86f4="">Bitcoin</span><span data-v-326d86f4="">BEP20(BSC)</span><span data-v-326d86f4="">Bitcoin(SegWit)</span></div>
</td>
<td data-v-326d86f4="">0.001</td>
<td data-v-326d86f4="">0.002</td>
</tr>
<tr data-v-326d86f4="">
<td data-v-326d86f4="">ETH</td>
<td data-v-326d86f4="" class="block-chain">
<div data-v-326d86f4="" class="chain_box"><span data-v-326d86f4="" class="chain_name">ERC20</span> <span data-v-326d86f4=""><i data-v-326d86f4="" class="fa fa-caret-down"></i></span></div>
<div data-v-326d86f4="" class="select-list"><span data-v-326d86f4="">ERC20</span><span data-v-326d86f4="">BEP20(BSC)</span><span data-v-326d86f4="">POLYGON</span><span data-v-326d86f4="">ARBITRUM</span><span data-v-326d86f4="">AURORA</span><span data-v-326d86f4="">METISEVM</span></div>
</td>
<td data-v-326d86f4="">0.012</td>
<td data-v-326d86f4="">0.024</td>
</tr>
<tr data-v-326d86f4="">
<td data-v-326d86f4="">USDT</td>
<td data-v-326d86f4="" class="block-chain">
<div data-v-326d86f4="" class="chain_box"><span data-v-326d86f4="" class="chain_name">OMNI</span> <span data-v-326d86f4=""><i data-v-326d86f4="" class="fa fa-caret-down"></i></span></div>
<div data-v-326d86f4="" class="select-list"><span data-v-326d86f4="">OMNI</span><span data-v-326d86f4="">TRC20</span><span data-v-326d86f4="">ERC20</span><span data-v-326d86f4="">BEP20(BSC)</span><span data-v-326d86f4="">HECO</span><span data-v-326d86f4="">POLYGON</span><span data-v-326d86f4="">FTM</span><span data-v-326d86f4="">AVAX-C</span><span data-v-326d86f4="">ARBITRUM</span><span data-v-326d86f4="">METISEVM</span></div>
</td>
<td data-v-326d86f4="">30</td>
<td data-v-326d86f4="">50</td>
</tr>
<tr data-v-326d86f4="">
<td data-v-326d86f4="">QASH</td>
<td data-v-326d86f4="" class="block-chain">
<div data-v-326d86f4="" class="chain_box">
<span data-v-326d86f4="" class="chain_name">ERC20</span> <!---->
</div>
<!---->
</td>
<td data-v-326d86f4="">513</td>
<td data-v-326d86f4="">1026</td>
</tr>
I'm trying using the library htmlAgilityPack, without success with the code
Dim arqHtml As String = "C:\Users\Mattia\Desktop\ready.html"
Dim myHtml As HtmlAgilityPack.HtmlDocument = New HtmlAgilityPack.HtmlDocument()
myHtml.Load(arqHtml)
Dim myTable As HtmlAgilityPack.HtmlNode = myHtml.DocumentNode.SelectSingleNode("//table")
Dim myRows As HtmlAgilityPack.HtmlNodeCollection = myTable.SelectNodes("tr")
For Each tmpRow As HtmlAgilityPack.HtmlNode In myRows
Dim myCells As HtmlAgilityPack.HtmlNodeCollection = tmpRow.SelectNodes("td")
If myCells IsNot Nothing Then
Dim myToken As String = myCells(0).InnerText
Dim mySpans As HtmlAgilityPack.HtmlNodeCollection = myCells(1).SelectNodes("div[contains(@class,'select-list')]/span")
Dim myListBChain As New List(Of String)
For Each mySpan As HtmlAgilityPack.HtmlNode In mySpans
myListBChain.Add(mySpan.InnerText)
Next
RichTextBox1.Text += String.Join(", ", myListBChain)
End If
Next
which throw the error:
Object Reference not set to an instance of an object
on the line
For Each mySpan As HtmlAgilityPack.HtmlNode In mySpans
even if during debug, the compiler seems to be halfway to the final result like the following image
Thanks
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(262.40000000000003, 87%, 35%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EJZ%3C/text%3E%3C/svg%3E)
Try html-agility-pack.net, you can get it in nuget
Agree html is really weird, but with packet above and some work I believe you can get what you want
For documentation
Hey jose, thanks for your answer. I know the existence of that library since a long time, but I really don't know how to make it work, majorly for this kind of html that long/complicated.. I imagine there is an hardcode solution instead of using html agility pack that could make its job... I added the link of the page in the post.
Thanks
@Mattia Fanti
Html you provided is not same as you have in "image animation", as an example in animation I can see an element with class "select-list", but there is no such class in Html file.
Anyway, this can be due to incorrect file you even a Javascript code making some data transform. For the moment it doesn´t mater.
Here a "very simple" sample on how to get Token and BlockChain values with HtmlAgilityPack, for sure there should be a better way of selectors use, but it can give you an starting point.
string arqHtml = @"place full path to html file";
HtmlAgilityPack.HtmlDocument myHtml = new HtmlAgilityPack.HtmlDocument();
myHtml.Load(arqHtml);
HtmlAgilityPack.HtmlNodeCollection myTables= myHtml.DocumentNode.SelectNodes("//table");
HtmlAgilityPack.HtmlNode myTable = null;
foreach(HtmlAgilityPack.HtmlNode tmpTable in myTables) {
if(!tmpTable.HasClass("table2"))
{
myTable = tmpTable;
break;
}
}
HtmlAgilityPack.HtmlNodeCollection myRows = myTable.SelectNodes("tr");
foreach (HtmlAgilityPack.HtmlNode tmpRow in myRows)
{
HtmlAgilityPack.HtmlNodeCollection myCells = tmpRow.SelectNodes("td");
if (myCells != null)
{
string myToken = myCells[0].InnerText; // Value you looking for
string myBChain = myCells[1].InnerText; // Value you looking for
}
}
Hey Jose thanks a lot! I realized this afternoon that doing a simple inspect element doesn't give me the full html of the drop lists I've just come up to a conclusion and basically the html is being created dinamically every time I click on the lists, so luckly, because the website is not well coded, I opened manually every single drop list and they stay all open. So now I'm able to get all the full code html.
I'm hosting the html page completed and formatted, so which we can have a start to which work with html agility pack or whatever solution.
This is the file e5b3ct
Here the html code privatebin.net
Hope it helps.
Still thanks,
Mattia
Just follow the concept, navigate through html tree using selector. This sample uses file place on your first link.
So now you have a working sample
string arqHtml = @"place full path to html file";
HtmlAgilityPack.HtmlDocument myHtml = new HtmlAgilityPack.HtmlDocument();
myHtml.Load(arqHtml);
HtmlAgilityPack.HtmlNode myTable = myHtml.DocumentNode.SelectSingleNode("//table");
HtmlAgilityPack.HtmlNodeCollection myRows = myTable.SelectNodes("tr");
foreach (HtmlAgilityPack.HtmlNode tmpRow in myRows)
{
HtmlAgilityPack.HtmlNodeCollection myCells = tmpRow.SelectNodes("td");
if (myCells != null)
{
string myToken = myCells[0].InnerText;
HtmlAgilityPack.HtmlNodeCollection mySpans = myCells[1].SelectNodes("div[contains(@class,'select-list')]/span");
List<string> myListBChain = new List<string>();
foreach(HtmlAgilityPack.HtmlNode mySpan in mySpans)
{
myListBChain.Add(mySpan.InnerText);
}
}
}
Hey Jose, I've tried your code now.
I add the html file as a resource and translated to vb.net
Dim arqHtml As String = My.Resources.readyhtml
Dim myHtml As HtmlAgilityPack.HtmlDocument = New HtmlAgilityPack.HtmlDocument()
myHtml.Load(arqHtml)
Dim myTable As HtmlAgilityPack.HtmlNode = myHtml.DocumentNode.SelectSingleNode("//table")
Dim myRows As HtmlAgilityPack.HtmlNodeCollection = myTable.SelectNodes("tr")
For Each tmpRow As HtmlAgilityPack.HtmlNode In myRows
Dim myCells As HtmlAgilityPack.HtmlNodeCollection = tmpRow.SelectNodes("td")
If myCells IsNot Nothing Then
Dim myToken As String = myCells(0).InnerText
Dim mySpans As HtmlAgilityPack.HtmlNodeCollection = myCells(1).SelectNodes("div[contains(@class,'select-list')]/span")
Dim myListBChain As List(Of String) = New List(Of String)()
For Each mySpan As HtmlAgilityPack.HtmlNode In mySpans
RichTextBox1.Text += (mySpan.InnerText)
Next
End If
Next
but unfortunately it gives me an error on myHtml.Load(arqHtml)
as Characters not valid in the path. What I'm doing wrong?
Ok, just remove "@" sign before file path
As an example Insteaof @"C:\user\download\myfile.html" use just "C:\user\download\myfile.html"
edit1: i've removed the resources and add the simple path. In this case the error disappear, but there is an error at runtime on " For Each mySpan As HtmlAgilityPack.HtmlNode In mySpans"
Object Reference not set to an instance of an object
Mattia, just in case, pay attention to Intelisense
myHtml.Load expects a Stream, TextReader or File Path
On the other hand if you have an Html String you can use myHtml.LoadHtml()
Hi jose I don't know if you sow my last update, but there is no more the error on the path. Now it s a problem on the parsing I assume, because the text in the intelisense during debug on richtextbox is : "BitcoinBEP20(BSC)Bitcoin(SegWit)ERC20BEP20(BSC)POLYGONARBITRUMAURORAMETISEVMOMNITRC20ERC20BEP20(BSC)HECOPOLYGONFTMAVAX-CARBITRUMMETISEVM"
look
Mattia, I´m not too familiar with Winform Controls, can not help you RichTextBox.
You almost there, go back to basics, then later you decide how to place values in controls.
Here same code, note, I´m storing each value in a list of strings, the after looping, combine all values in a string. So you have values in 2 ways
Give a try on code as is. It should work
Dim arqHtml As String = "place full path to html file"
Dim myHtml As HtmlAgilityPack.HtmlDocument = New HtmlAgilityPack.HtmlDocument()
myHtml.Load(arqHtml)
Dim myTable As HtmlAgilityPack.HtmlNode = myHtml.DocumentNode.SelectSingleNode("//table")
Dim myRows As HtmlAgilityPack.HtmlNodeCollection = myTable.SelectNodes("tr")
For Each tmpRow As HtmlAgilityPack.HtmlNode In myRows
Dim myCells As HtmlAgilityPack.HtmlNodeCollection = tmpRow.SelectNodes("td")
If myCells IsNot Nothing Then
Dim myToken As String = myCells(0).InnerText
Dim mySpans As HtmlAgilityPack.HtmlNodeCollection = myCells(1).SelectNodes("div[contains(@class,'select-list')]/span")
Dim myListBChain As New List(Of String)
For Each mySpan As HtmlAgilityPack.HtmlNode In mySpans
myListBChain.Add(mySpan.InnerText)
Next
Dim allItensAsString = String.Join(", ", myListBChain)
End If
Next
My bad I did not pay proper attention, there is nothing wrong with RichTextBox, result you see is correct.
You are in a For Each loop, acumulating values on same control.....:-)
Hey Jose, the error I'm getting its not about the richtextbox, it's an error on the former line "For Each mySpan As HtmlAgilityPack.HtmlNode In mySpans"
The code " RichTextBox1.Text += (mySpan.InnerText)" is okay..
myListBChain.Add seems to be a listbox control.
So trying with your control it gives the same error. In which environment are you testing it so if you are not using windows form control?
Can you show me a screenshot of your output please? Thanks
Got it, at some rows there is no span, so have to check before go ahead.
So here the bad part of, even if did not got an weird html as this one, you should have in mind that your code is tied to html source, and you have to inspect html and compare with your code. Means any change in html can impact your code. Try new code again
Dim arqHtml As String = "place full path to html file"
Dim myHtml As HtmlAgilityPack.HtmlDocument = New HtmlAgilityPack.HtmlDocument()
myHtml.Load(arqHtml)
Dim myTable As HtmlAgilityPack.HtmlNode = myHtml.DocumentNode.SelectSingleNode("//table")
Dim myRows As HtmlAgilityPack.HtmlNodeCollection = myTable.SelectNodes("tr")
For Each tmpRow As HtmlAgilityPack.HtmlNode In myRows
Dim myCells As HtmlAgilityPack.HtmlNodeCollection = tmpRow.SelectNodes("td")
If myCells IsNot Nothing Then
Dim myToken As String = myCells(0).InnerText
Dim mySpans As HtmlAgilityPack.HtmlNodeCollection = myCells(1).SelectNodes("div[contains(@class,'select-list')]/span")
If mySpans IsNot Nothing Then
Dim myListBChain As New List(Of String)
For Each mySpan As HtmlAgilityPack.HtmlNode In mySpans
myListBChain.Add(mySpan.InnerText)
Next
Dim allItensAsString = String.Join(", ", myListBChain)
End If
End If
Next
End Sub
hey Jose, still many thanks for your kind help.
Just tried your code update and this time I'm getting an output without errors, but it seems a wrong one which not correspond to the one In my first post.
I'll append the complete output here:
BitcoinBEP20(BSC)Bitcoin(SegWit)ERC20BEP20(BSC)POLYGONARBITRUMAURORAMETISEVMOMNITRC20ERC20BEP20(BSC)HECOPOLYGONFTMAVAX-CARBITRUMMETISEVMEOSBEP20(BSC)ERC20BEP20(BSC)TRC20BEP20(BSC)ZILBEP20(BSC)NEOLEGACYNEON3ERC20POLYGONERC20DAGBEP2BEP20(BSC)FTMAVAX-CERC20BEP20(BSC)ERC20BEP20(BSC)ERC20HECOBEP20(BSC)ERC20HECOERC20POLYGONERC20HECOERC20POLYGONERC20BEP20(BSC)BCHBEP20(BSC)ERC20LOOPPOLYGONBEP20(BSC)FTMAVAX-
p.s. I deleted half of the output cause of the limit of characters in this comment, by the way you clearly see that this is not the right out put :D
I solved with
Dim arqHtml As String = "C:\Users\Mattia\Desktop\ready.html"
Dim myHtml As HtmlAgilityPack.HtmlDocument = New HtmlAgilityPack.HtmlDocument()
myHtml.Load(arqHtml)
Dim myTable As HtmlAgilityPack.HtmlNode = myHtml.DocumentNode.SelectSingleNode("//table")
Dim myRows As HtmlAgilityPack.HtmlNodeCollection = myTable.SelectNodes("tr")
For Each tmpRow As HtmlAgilityPack.HtmlNode In myRows
Dim myCells As HtmlAgilityPack.HtmlNodeCollection = tmpRow.SelectNodes("td")
If myCells IsNot Nothing Then
Dim myToken As String = myCells(0).InnerText
Dim mySpans As HtmlAgilityPack.HtmlNodeCollection = myCells(1).SelectNodes("div[contains(@class,'select-list')]/span")
Dim chainText As String
If mySpans Is Nothing Then
Dim chainTextNode As HtmlAgilityPack.HtmlNode = myCells(1).SelectSingleNode(
"div[contains(@class, 'chain_box')]/span[contains(@class, 'chain_name')]"
)
chainText = If(chainTextNode Is Nothing OrElse String.IsNullOrWhiteSpace(chainTextNode.InnerText), "(unknown)", chainTextNode.InnerText)
Else
chainText = String.Join(", ", mySpans.Select(Function(span) span.InnerText))
' Alternative: chainText = String.Join(", ", From span In mySpans Select span.InnerText)
End If
RichTextBox1.Text &= $"{myToken} - {chainText}{Environment.NewLine}"
End If
Next
Great, I knew code was ok and of course there was some minor adjustments to fit your needs.
By the way mark your question as answered
For some reason I can't mark the question as Answered, but I mark your answer as the answer since you helped me a lot! Thanks Jose