Get information from screen and finding patterns

endless_dark · 2011-05-01 14:38:54

Hello! I want to try bot programming for games and stuff.
The main problem I have is that the bot input should be taken from screen, and bot output should be an input (like: move mouse, click, move mouse...)

Taking for example this simple game:
http://www.onlinegames.com/basketball/

The algorithm should be:
1.- Find ball
2.- Find basket
3.- Find clicking place
4.- Click

But I don't know how to get info from screen, finding patterns and writing the output.

Any clue on what should I read about? articles, keywords, whatever.
Thank you very much!

Malvineous · 2011-05-02 07:49:24

Search for "artificial intelligence" - I think if you were able to solve the first two steps in your proposed algorithm you would become a millionaire :-)

Depending on the crudeness of the graphics in the game, you might be able to just search for a particular pattern of pixels, but it's not going to be fast. If you're doing this to cheat in games, it would be far simpler and more effective to reverse engineer the communication protocol and send fake events back to the server...

endless_dark · 2011-05-02 14:08:27

I found this

http://www.youtube.com/watch?v=kctMU65yxWc

I'm not interested in the game cheating, just in how this kind of bots are programmed.
This one for example uses screen recognition, using some kind of software

Arch Linux

#1 2011-05-01 14:38:54

Get information from screen and finding patterns

#2 2011-05-02 07:49:24

Re: Get information from screen and finding patterns

#3 2011-05-02 14:08:27

Re: Get information from screen and finding patterns

Board footer