Do we have a functionality to Click Text on an application? As in a functionality without using OCR engine.
How would it know what to click then ?
You need to FIND the text before you can click it.
So choose one of the different technologies (windows, ie, nm, java, sap etc) and use the "Get Element" for that tech, and then use "Click Element" to click at the location it found using the Get Element.
But speaking of OCR. If you use image recognition, you can search for text using OCR with the "Get Text" activity and then use "Click Element" to click the text.
m365 last edited by m365
@allan-zimmermann in my situation, there is a block of text spanning across multiple lines and the element selector was only able to find the large block - not the individual text elements inside the block.
I assume that if this function was available, it should be able to :
- extract the text content from within the element block
- figure out the position of the text you are trying to search
- move the mouse to that position (or click on that text's position)
Related functions (I think):
Notice almost all activities use IElement, not "imageElement" or "NMElement" etc.
So that means you can mix them.
Use "windows get element" or "nm element" or what ever makes sense in your scenario, and then you can use Image "Get Text" inside that, to find the word your looking for, and that will return an ImageElement that contains the text and coordinates. If you just want to click it, then add a Click Element inside the Get Text ?
@allan-zimmermann Understood. And this will require the resolution and dpi settings to be consistent if the automation is moved to another machine - right?
Maybe .... since you are using OCR in the example, it should be able to get the text no matter the size of the text. So my best guess would be "no"
@allan-zimmermann Sounds good. Will give it a try.