Vecy: On-device AI & LLM APP for RAG

Vecy is an Android AI app that enables private LLM chats using local files through RAG. It automatically processes and indexes documents, photos, and other files, allowing users to interact with their data securely. With support for multiple LLM sizes and offline functionality, it enhances response accuracy by leveraging embedding vectors generated from local content.

What is Vecy: On-device AI & LLM APP for RAG?

Vecy is an Android AI app that allows users to chat with fully-private LLMs and local files (documents, photos). It automatically processes and indexes local files on the phone, and users can also directly upload files. Vecy offers RAG tools for processing local files to enhance LLM responses. Users can select from a range of small LLMs (from 0.5B to 3.5B parameters) and engage in conversations with documents stored locally. The app automatically processes files (PDFs, DOCX documents, images, etc.) within the Documents, Download, and DCIM directories to generate embedding vectors, which are stored locally on the device. These embedding vectors are crucial for RAG (retrieval-augmented generation) capabilities, enhancing the LLM's ability to provide more accurate and relevant responses when queries are related to the local files.

Use Cases

• Chat with local documents and images using a private LLM
• Enhance LLM responses with embedded file data
• Search and retrieve information from local files
• Converse with documents stored on your device
• Use image search features for visual data retrieval

Core Benefits

• Fully private LLM conversations
• Automatic file processing and indexing
• RAG capabilities for accurate responses
• Offline functionality
• Image search

Key Features

• Chat with fully-private LLMs
• Process and index local files automatically
• Direct file upload
• RAG tools for enhanced LLM responses
• Image search

How to Use

1. 1
   Install the Vecy app on your Android device.
2. 2
   The app automatically processes files in the Documents, Download, and DCIM directories.
3. 3
   You can also upload files directly.
4. 4
   Select an LLM and start chatting with your local files.

Frequently Asked Questions

Pros & Cons (Reserved)

Alternatives