I'd be really interested in feedback on the security model of client-side agents giving extension-bridge access, and taking questions on the implementation!
general_reveal 27 minutes ago [-]
I’ve been thinking about something like this. If it’s just a one line script import, how the heck are you trusting natural language to translate to commands for an arbitrary ui?
The only thing I can think of is you had the AI rewrite and embed selectors on the entire build file and work with that?
mentalgear 46 minutes ago [-]
> Data processed via servers in Mainland China
Appreciate the transparency, but maybe you could add some European (preferably) alternatives ?
simon_luv_pho 19 minutes ago [-]
I'm looking into a European testing endpoint. The problem is I don't have enough resources to figure out all the legal and compliance requirements, and persuading my company to pay for that infrastructure is gonna be a tough sell.
simon_luv_pho 37 minutes ago [-]
Please use your own LLM api instead!
The free testing LLM is Qwen hosted by Aliyun. Qwen and DeepSeek are the only ones I can afford to offer for free. It's just there to lower the try-out barrier; please DO NOT rely on it.
The library itself does NOT include any backend service. Your data only goes to the LLM api you configured.
I tested it on local Ollama models it works fine.
Mnexium 24 minutes ago [-]
Curious - how does it perform with captchas and other "are you human" stuff on the web?
simon_luv_pho 7 minutes ago [-]
I added in the system prompt that it should skip CAPTCHAs and hand control back to the user. Currently working on a proper human-in-the-loop feature. That's actually one of the key advantages of running the agent inside your own browser.
dzink 52 minutes ago [-]
Is this Affiliated with the Chinese company Alibaba? Any chance data goes there too?
simon_luv_pho 22 minutes ago [-]
Full transparency: I work at Alibaba and published this under Alibaba's open-source org. I maintain it during work hours, so yes, Alibaba technically pays me for it. That said, this is my project — it's MIT-licensed, includes no backend service, and is open for anyone to audit.
The free testing LLM endpoint is hosted on Alibaba Cloud because I happen to have some company quota to spend, but it's not part of the library. Bring your own LLM and there is zero data transmission to Alibaba or anywhere else you haven't configured yourself.
I highly recommend using it with a local Ollama setup.
MeteorMarc 1 hours ago [-]
Confusing name because of the existence of pageant, the putty agent.
simon_luv_pho 48 minutes ago [-]
Darn. Pageant would've been a nice name though. Maybe `page-agent.js` is more relevant in web dev community.
kirth_gersen 56 minutes ago [-]
Came here to say missed opportunity to call it "PAgent". Rolls off the tongue better than Page Agent.
pscanf 2 hours ago [-]
Very cool!
I'm particularly impressed by the bookmark "trick" to install it on a page. Despite having spent 15 years developing for the browser, I had somehow missed that feature of the bookmarks bar. But awesome UX for people to try out the tool. Congrats!
23 minutes ago [-]
simon_luv_pho 2 hours ago [-]
Thanks!
Bookmarklets are such an underrated feature. It's super convenient to inject and test scripts on any page. Seemed like the perfect low-friction entry point for people to try it out.
Spent some time on that UX because the concept is a bit hard to explain. Glad it worked!
popalchemist 13 minutes ago [-]
Does it support long-click / click-and-drag?
simon_luv_pho 3 minutes ago [-]
Not yet. Currently focused on the more common interaction patterns. PRs welcome though!
coreylane 53 minutes ago [-]
Looks cool! Are you open to adding AWS Bedrock or LiteLLM support?
simon_luv_pho 15 minutes ago [-]
Thanks!
It supports any OpenAI-compatible API out of the box, so AWS Bedrock, LiteLLM, Ollama, etc. should all work. The free testing LLM is just there for a quick demo. Please bring your own LLM for long-time usage.
1 hours ago [-]
jauntywundrkind 2 hours ago [-]
Not exactly the same but I'd also point to Paul Kinlan's FolioLM as a very interesting project in this space. A very nice browser extension,
> Collect and query content from tabs, bookmarks, and history - your AI research companion. FolioLM helps you collect sources from tabs, bookmarks, and history, then query and transform that content using AI.
- GitHub: https://github.com/alibaba/page-agent
- Live Demo (No sign-up): https://alibaba.github.io/page-agent/ (you can drag the bookmarklet from here to try it on other sites)
- Browser Extension: https://chromewebstore.google.com/detail/page-agent-ext/akld...
I'd be really interested in feedback on the security model of client-side agents giving extension-bridge access, and taking questions on the implementation!
The only thing I can think of is you had the AI rewrite and embed selectors on the entire build file and work with that?
Appreciate the transparency, but maybe you could add some European (preferably) alternatives ?
The free testing LLM is Qwen hosted by Aliyun. Qwen and DeepSeek are the only ones I can afford to offer for free. It's just there to lower the try-out barrier; please DO NOT rely on it.
The library itself does NOT include any backend service. Your data only goes to the LLM api you configured.
I tested it on local Ollama models it works fine.
The free testing LLM endpoint is hosted on Alibaba Cloud because I happen to have some company quota to spend, but it's not part of the library. Bring your own LLM and there is zero data transmission to Alibaba or anywhere else you haven't configured yourself.
I highly recommend using it with a local Ollama setup.
I'm particularly impressed by the bookmark "trick" to install it on a page. Despite having spent 15 years developing for the browser, I had somehow missed that feature of the bookmarks bar. But awesome UX for people to try out the tool. Congrats!
Bookmarklets are such an underrated feature. It's super convenient to inject and test scripts on any page. Seemed like the perfect low-friction entry point for people to try it out.
Spent some time on that UX because the concept is a bit hard to explain. Glad it worked!
It supports any OpenAI-compatible API out of the box, so AWS Bedrock, LiteLLM, Ollama, etc. should all work. The free testing LLM is just there for a quick demo. Please bring your own LLM for long-time usage.
> Collect and query content from tabs, bookmarks, and history - your AI research companion. FolioLM helps you collect sources from tabs, bookmarks, and history, then query and transform that content using AI.
https://github.com/PaulKinlan/NotebookLM-Chrome https://chromewebstore.google.com/detail/foliolm/eeejhgacmlh...