Skip to content
NEWMarketplace and the trig8n Agent: sell what you build, and get plans and changes that are tested before you see them. See what is new

Library / Files & Cloud Storage

Files & Cloud Storage

[1/3 - anomaly detection] [1/2 - KNN classification] Batch upload dataset to Qdrant

When you run it, it manages files using Google Cloud Storage.

Import it free Sign in to open it

What it does

Now it's time to embed & upload to Qdrant our image datasets; Both of them, crops (you should replace it with your image datasets) Datasets consist of image URLs; images are grouped by folders based on their class. For example, we have a system of subfolders like *"tomato"* and *"cucumber"* for the crops dataset with image URLs of the respective class.

The steps

  1. When clicking ‘Test workflow’
  2. Google Cloud Storage
  3. Get fields for Qdrant
  4. Qdrant cluster variables
  5. Embed crop image
  6. Create Qdrant Collection
  7. Check Qdrant Collection Existence
  8. Batches in the API's format
  9. Batch Upload to Qdrant
  10. Split in batches, generate uuids for Qdrant points
  11. If collection exists
  12. Payload index on crop_name
  13. Filtering out tomato to test anomalies

Similar automations

Files & Cloud Storage[1/3 - anomaly detection] [1/2 - KNN classification] Batch upload dataset to Qdrant13 stepsRAG & Knowledge BasesUpload Crop Images to Qdrant for Anomaly Detection13 stepsRAG & Knowledge BasesEmbed Image Datasets into Qdrant for Anomaly Detection60 stepsRAG & Knowledge BasesEmbed Image Datasets into Qdrant for Anomaly Detection60 steps