Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Implement Windows UI monitoring with dynamic querying using IUIAutomation #945

Draft
wants to merge 2 commits into
base: main
Choose a base branch
from

Conversation

varshith257
Copy link
Contributor

@varshith257 varshith257 commented Dec 12, 2024


name: pull request
about: submit changes to the project
title: "[pr] "
labels: ''
assignees: ''


description

brief description of the changes in this pr.

related issue: #

how to test

add a few steps to test the pr in the most time efficient way.

if relevant add screenshots or screen captures to prove that this PR works to save us time.

if you think it can take more than 30 mins for us to review, we will pay between $20 and $200 for someone to review it for us, just ask in the pr.

Closes #703

Copy link

vercel bot commented Dec 12, 2024

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
screenpipe ✅ Ready (Inspect) Visit Preview 💬 Add feedback Dec 12, 2024 1:48pm

@varshith257
Copy link
Contributor Author

@louis030195 I have drafted PR with what I understood from existing to implement. Let me know if any other changes or suggestions to incorporate

@louis030195
Copy link
Collaborator

i don't understand what is this doing

why is there a ui_monitoring.exe ?

we should implement this in pure rust

@louis030195
Copy link
Collaborator

look at this file: https://github.com/mediar-ai/screenpipe/blob/main/screenpipe-vision/src/ui_monitoring_macos.swift

apple does not have good support for rust so we compiled a swift binary

we should have similar logic to scrap the desktop using windows rs lib - pure rust

@louis030195
Copy link
Collaborator

any update

@varshith257
Copy link
Contributor Author

Just triggering the way how we can go with it

@louis030195 louis030195 marked this pull request as draft December 18, 2024 13:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[bounty] Windows UI Automation
2 participants