Is Selenium worth the pain?

We have been going through similar pains with Selenium. Sometimes Selenium fails without any deterministic reason. We could figure some issues within our test usage. However, there are other failures which are totally random and do not give any clue. Running from command prompt with maven resulted in test failures at different places than the ones that appear when tested from within eclipse. Arggh.

While I agree Selenium can be a pain to work with against ajax enabled pages, I personally think it is a great product
- it's free!!!
- it is not even on version 1 yet (0.9.0), can only get better
- API's exist for multiple programming languages

by the way the 'Atlassian Developer Blog' link in the article is busted - prefixed with 'link:'

Selenium is great! But not so great to put it into production. Developers can use it randomly to assist them. It fits with agile practices, but can not run reliably in production yet.

I am not sure why the development is so slow (no updates since dec 2006). With Web2.0 applications, so many languages and browsers, (functional) testing on a regular basis is necessary. I would suggest to develop Selenium without going into conclusions (like pain).

But not so great to put it into production

Are you suggesting that developers should write Selenium tests for the purposes of development, but not run them as a regular test suite?
If so, then that seems like a very strange position to take.

It is worth it.

I have used HttpUnit for a few years and that had some advantages. The best was that once you have written your test, you could start it on a great many threads and knock seven bells out of your server. This is not so easy with Selenium as it requires one instance of FireFox, IE or another to simulate one user.

However, writting the test in the first place is much easier with Selenium IDE, and keeping it upto date as the UI changes is quite easy too. With HttpUnit I quite often had to revert to debugging my unit test to see what was in the page that had been returned by the server.

OK using Selenium with AJAX isn't a smooth ride yet. I think selenium.type() will set the value of the node in the DOM instead of simulating key presses. However, one of the really nice things about Selenium is where it doesn't quite do what you need, it is very easy to extend. Create your own user-extensions.js, put the following in it, and set up the extensions file in the options:

Selenium.prototype.doTypeKeys = function(locator, value) {
    for(var i=0; i<value.length; i++){
        var key = value.charAt(i);
        if(browserVersion.isIE){
            // whatever you need to do for IE
        }
        else { /* Mozilla? */
            this.doKeyDown(locator, key);
            this.doKeyPress(locator, key);
            this.doKeyUp(locator, key);
        }
    }
};
>

On thinking about it - you probably shouldn't do both a keyPress and a keyUp. You should only need keyDown and a keyUp, any onKeyPress event handler would still be fired. May be this why you get double key strokes in other browsers to FireFox.

blogs.atlassian.com/developer/2007/08/selenium_...

I had to poke around a bit to find it!

sahi.co.in/ -- from what I have seen, it's pretty good at behaving like a user

I must confess that at first glance Sahi looks impressive. Thanks for sharing.

./alex
--
.w( the_mindstorm )p.
________________________
Alexandru Popescu
Senior Software Eng.
InfoQ TechLead&CoFounder

First link in this item now fixed, thanks for pointing it out.

I've been working with selenium since last year and it´s great for web test.
It´s true that ajax have been a problem for selenium but the extensibility allows anything.
The posibility of implemet new commands have allowed me, and my company, to solve the problems implementing personalized comands.

Selenium: It works... and if it doesn´t you could make it work!

Another contender may be: Chickenfoot. Funny name, isn't it? :-).

./alex
--
.w( the_mindstorm )p.
________________________
Alexandru Popescu
Senior Software Eng.
InfoQ TechLead&CoFounder

hi,
i am judit...
i have a doubt....
when i am clicking a link in a page it is opening it in a new tab...
how to verify whether the new page is opened....