A new app called PixelShot extends the Pixel Screenshots AI experience to nearly every modern Android smartphone. Although the app does need some internet connectivity, it can extract and process text from screenshots.
PixelShot app offers access to Pixel Screenshots AI on other Android smartphones
Ever since Google launched the Pixel 9 series of smartphones, the company has been rolling out new features and apps that are exclusive to these flagship smartphones. The Pixel Screenshots is one such Pixel-exclusive app. It relies on-device AI and Gemini to analyze the screenshots. It extracts text and other relevant info from those screenshots to make it available for later use.
PixelShot iOS is live on Product Hunt 🥳 Please leave your feedback and share your experience with the PixelShot app.https://t.co/EasE6bBM3E https://t.co/RuUFX7LlBn
— Mehul Kanzariya (@mehul4795) October 24, 2024
With the power of Artificial Intelligence (AI), Pixel Screenshots can gather, process, and then present information as per the user’s queries. Needless to say, every Android smartphone can benefit from such an app.
The PixelShot app essentially recreates Pixel Screenshots AI experience for non-Pixel smartphones. Developed by Mehul Kanzariya, the PixelShot app processes screenshots to extract text. The newly released app is available on the Google Play Store, and it is free, for now.
How does the PixelShot app work?
After extracting text from screenshots, PixelShot uses an AI model to generate summaries of that text. Similar to the Pixel Screenshots app, the PixelShot app reportedly allows users to manually add notes to individual screenshots and organize them into collections.
Available for all Android devices running Android 11 and later, the PixelShot app is free, and there are no ads. However, given the amount of processing the app is doing, its developer has hinted at plans to monetize the platform.
The developer of PixelShot has assured that screenshots never leave the device. However, text from the screenshots gets uploaded to the cloud for an AI model to summarize it.
Specifically speaking, the machine learning model provided by Google’s ML Kit SDK, helps in on-device text extraction from screenshots. The Llama 3 8B Instruct, hosted on Replicate, then processes the uploaded text. PixelShot relies on local AI to generate a title and summary. These are stored locally on the device using a Room Database.
PixelShot can only handle or process text and the app needs to be running in the foreground. The Pixel Screenshots app can process images of products to generate a relevant summary in the background.
PixelShot for Android is live now. The easiest way to find old Screenshots when you need them using #AI pic.twitter.com/Zh2ydBqNtR
— Mehul Kanzariya (@mehul4795) November 13, 2024
