Navigation

    OpenIAP
    • Login
    • Search
    • Categories
    • Recent
    • Tags
    • Popular
    • Users
    • Groups

    OpenRPA to get UIElements in context menu (and hover-based submenus)

    General Discussion
    2
    6
    51
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • A
      axel.rp last edited by

      Working with OpenRPA in offline mode, is there a way to get hold of UIElements which are burried in the context menu? In my case, I have a context menu which holds a submenu that unfolds to the side, when hovering over a certain context menu item. How can the Selector capture these elements in the context menu and its submenus?
      I currently take a screenshot of the Context menu and it's submenus in order to use image recognition to find the Element which I need but it's definitely not the preferred option and I hope I can get the Selector to detect it somehow.

      Allan Zimmermann 1 Reply Last reply Reply Quote 0
      • Allan Zimmermann
        Allan Zimmermann @axel.rp last edited by

        @axel-rp What type of application ? Sap, Java, windows, chrome ?

        A 1 Reply Last reply Reply Quote 0
        • A
          axel.rp @Allan Zimmermann last edited by axel.rp

          Hi Allan, in my particular case, I'm trying to automate something in the open-source software QGIS running on Windows 10. It uses Python and the GUI is made with Qt as far as I know. I can trigger the context-menu but after that I would need to click in the Selector for selecting the menu item that I want and by doing that, I loose the Context Menu again.
          Note: In TagUI there is a 5 seconds delay option to capture these hover-triggered submenus. From another question of mine with respect to the F2 button annoyance, you said the recording action actually comes with a delay, which is exactly what is needed here.

          A 1 Reply Last reply Reply Quote 0
          • A
            axel.rp @axel.rp last edited by

            UPDATE: I tried to catch a submenu entry with the F2 key and the Selector actually captured something. But when executing the workflow it fails to locate it, despite a one second delay before the respective submenu item.

            Allan Zimmermann 1 Reply Last reply Reply Quote 0
            • Allan Zimmermann
              Allan Zimmermann @axel.rp last edited by

              Hi @axel-rp I downloaded QGIS ( man that is a big installer ) and played around a little ... seems this framework is ignoring the "invoke" action, so you need to disable virtual clicking .. you can do that "per" "ClickElement" in the "Virtual Click" property,
              7a488e74-1d71-43cd-b035-e0ab5acaa252-image.png or you can change the default for all new Click Elements under settings
              49bef607-3597-4ae9-bae2-99078bce7c44-image.png

              Allan Zimmermann 1 Reply Last reply Reply Quote 0
              • Allan Zimmermann
                Allan Zimmermann @Allan Zimmermann last edited by Allan Zimmermann

                Also, sometimes the "small" selectors was giving me issues, so you can play around with disabling or enabling these two setting under Settings-> Recorder Plugins -> Windows
                db4077cf-ec94-4f05-99ee-3e1888f828d7-image.png
                ( you must disable or enable them both at the same time )

                1 Reply Last reply Reply Quote 0
                • Referenced by  A axel.rp 
                • Referenced by  A axel.rp 
                • Locked by  A az 
                • First post
                  Last post