1
Hi everyone! As a side project I have created something that I would like to ask you all to get your feedback and if that is something you would be interested in using.
It's a remote phone instance running in the cloud where I install and use all apps that may be leaking private data such as geolocation, activity time, microphone, gyroscope and what not. In principle its an Android instance which I access with VNC client from my iPhone. Everything on the server side is based on AOSP (Android Open Source), encrypted and in a Docker container with all of its security features. The only downside is that when I'm in a rural area the VNC can get laggy and it's pretty much unusable.
I was thinking about releasing it as a service to the general public for a small fee lets say $10/mo to cover the server cost and making some fancy integrations like Zadarma to use separate phone number, VPN to hide the server location, or a dedicated mobile app to optimize traffic data (VNC can be data-heavy).
What do you think?
As in the title, I am wondering what are the reasons anyone would use Puppeteer/Selenium/other-browser-emu for web scraping if there are already tens if not hundreds of SaaS services offering "scraping-as-a-service". Except for JS execution.
A handful of examples: Scrapehero, Webrobots, Apify, Scrapingbee, Scrapinghub, Promptcloud
Except for the ones that require setup fee, or have ridiculous pricing models. Why would anyone want to setup Puppeteer/Selenium/other scraping bots instead of using one of the "scraping-as-a-service" platforms?
For the past few months, together with two other devs I have worked on a customized Puppeteer/Playwright scraping backend. It's essentially a drop-in replacement for default Chrome/FF binaries. We managed to successfully go through Coinbase, Amazon, Aliexpress login pages in headless mode without getting captcha, or any other verification. We are planning to roll out a beta version. If you are interested in getting beta access leave us details about your use case here: https://a90eq67iroz.typeform.com/to/FAkWnrtv
The motivation for our project is that open-source solutions such as puppeteer-extra-stealth cover only a small portion of what popular anti-bot software such as Akamai Bot Manager or Imperva use to detect and ban emulated browsers.
In particular, I am looking for a tool/platform that would help me gather stats from the extension galleries, payments and deployment.
There are partial solutions for this. Like https://www.npmjs.com/package/chrome-webstore-upload that I could connect with CircleCI to get my extension to Chrome gallery, or https://github.com/mozilla/webextension-polyfill to make my extension compatible with FF and Chrome.
Edit: There is also https://github.com/EmailThis/extension-boilerplate but only as a starter. Nothing like CRA for extensions.
People join my company: I add their Github handles to a group at Github, Slack and a few more including iOS Dev team.
I am looking for a tool that would give me an overview on all these accounts, showing who has access where with what account, so that whenever someone joins or leaves the company I can manage them easily and never forget about any of them.
I know SSO would partially solve the problem, but I am hoping there is a solution that doesn't require it.