There are cases when Selenium WebDriver is not the best option for creating test scripts.

If the test script involves navigating through a lot of pages, using HTML parsing libraries like JSOUP is a better choice than Selenium WebDriver.

0135b-cooking

JSOUP is a Java library for working with real-world HTML.

It provides a simple API for extracting and manipulating data, using the DOM, CSS, and jquery-like methods.

JSOUP parses HTML to the same DOM as modern browsers do.

scrape and parse HTML from a URL, file, or string

find and extract data, using DOM traversal or CSS selectors

manipulate the HTML elements, attributes, and text

How does a script using JSOUP look like?

@Test public void test1() {

Document resultsUrl = Jsoup.connect(basePageUrl).get();

Elements titles = resultsUrl.select(“span.title");

for (Element title : titles) {

Element link = title.child(0);

String detailsUrl = basePageUrl +link.attr(“href");

Document detailUrl = Jsoup.connect(detailsUrl).get();

Elements bookTitle = detailsUrl.getElementsByAttributeValue(“testid", “text_bibtitle");

if (bookTitle.size() > 0)
assertTrue(bookTitle.get(0).text().length() > 0);

Elements bookAuthor = detailUrl.getElementsByAttributeValue(“testid", “author_search");

if (bookAuthor.size() > 0)
assertTrue(bookAuthor.get(0).text().length() > 0);
}

}

}