Javascript (and HTML rendering) engine without a GUI for automation?

Posted by MTsoul on Stack Overflow See other posts from Stack Overflow or by MTsoul
Published on 2010-04-26T19:26:49Z Indexed on 2010/04/27 23:53 UTC
Read the original article Hit count: 239

Filed under:

mechanize

|

automation

|

JavaScript

|

rendering

|

python

Are there any libraries or frameworks that provide the functionality of a browser, but do not need to actually render physically onto the screen?

I want to automate navigation on web pages (Mechanize does this, for example), but I want the full browser experience, including Javascript. Thus, I'd like to have a virtual browser of some sort, that I can use to "click on links" programmatically, have DOM elements and JS scripts render within it, and manipulate these elements.

Solution preferably in Python, but I can manage others.

© Stack Overflow or respective owner

Related posts about mechanize

python mechanize.browser submit() related problem

as seen on Stack Overflow - Search for 'Stack Overflow'
Hello All im making some script with mechanize.browser module. one of problem is all other thing is ok, but when submit() form,it not working, so i was found some suspicion source part. in the html source i was found such like following. <form method="post" onsubmit="return loginCheck(this)"… >>> More
How to set the mechanize page encoding?

as seen on Stack Overflow - Search for 'Stack Overflow'
Hi, I'm trying to get a page with an ISO-8859-1 encoding clicking on a link, so the code is similar to this: page_result = page.link_with( :text => 'link_text' ).click So far I get the result with a wrong encoding, so I see characters like: 'T?tulo:' instead of 'Título:' I've tried several… >>> More
WWW::Mechanize-Question

as seen on Stack Overflow - Search for 'Stack Overflow'
Hello! Are both of these versions OK or is one of them to prefer? #!/usr/bin/env perl use strict; use warnings; use WWW::Mechanize; my $mech = WWW::Mechanize->new(); my $content; # 1 $mech->get( 'http://www.kernel.org' ); $content = $mech->content; say $content; # 2 my $res = $mech->get(… >>> More
Python mechanize to follow image links?

as seen on Stack Overflow - Search for 'Stack Overflow'
mechanize's Browser class is great and it's follow_link() function is great too. But what to do with this kind of links: <a href="http://example.com"><img src="…"></a> Is there any way to follow such links? The text attribute of this type of links is simply '[IMG]', so AFAIK,… >>> More
WWW::Mechanize Perl login only works after relaunch

as seen on Stack Overflow - Search for 'Stack Overflow'
Hello, I'm trying to login automatically in a website using Perl WWW::Mechanize. What I do is: $bot = WWW::Mechanize->new(); $bot->cookie_jar( HTTP::Cookies->new( file => "cookies.txt", autosave => 1, ignore_discard =>… >>> More

Related posts about automation

Documenting applications - automation / semi-automation for screenshots?

as seen on Stack Overflow - Search for 'Stack Overflow'
For me one of the biggest bores of being a developer is writing user documentation. (I am referring to the stuff that gets exported into PDF files files that ship with the product, not comments in code here). The task off adding or updating new bits of text to the existing documentation is OK. However… >>> More
Why the cucumber features keeps running even though it fails?

as seen on Stack Overflow - Search for 'Stack Overflow'
Its a rails 2.3.5 app. I'm using the rspec and cucumber for testing. When I run autospec, it runs correctly with the warning (Not running features. To run features in autotest, set AUTOFEATURE=true.) as below: [~/rails_apps/automation (campaign)?] ? autospec (Not running features. To run features… >>> More
Automation testing tool for Regression testing of desktop application

as seen on Stack Overflow - Search for 'Stack Overflow'
Hi I am working on a desktop application which uses Infragistic grids. We need to automate the regression tests for same. QTP alone does not support this, we need to buy new plug in for same which my company is not very much interested in. Do we have any open source tool for automating regression… >>> More
automation of data format conversion to parent child format

as seen on Stack Overflow - Search for 'Stack Overflow'
This is an excel sheet which has only a single column filled for each row. (explanation : all CITY categories fall under V21 , all handset categories fall under CityJ and so on ) V21 CITYR CITYJ HandsetS HandsetHW HandsetHA … >>> More
Automation: how to automate transforming .doc to .docx?

as seen on Stack Overflow - Search for 'Stack Overflow'
I have a bunch of .doc files in a folder which I need to convert to .docx. To manually convert the .doc to .docx is pretty simple: Open .doc in Word 2007 Click on Save As... Save it as .docx However, doing this for hundreds of files definitely ain't fun. =p How would you automate this? >>> More