Hi,I’ve been following the Pinecone docs for llamaindex to create a RAG app.Basically,in this doc we load, embedd and store the data in a single go.
I was wondering on how to insert a data without affecting the existing data. At first, i thought of using namespaces for different kinds of data but what if i just wanted to add a data to a pre-existing namespace without overriding the existing data. Since ill be using embedding model to first convert the data into vectors it’ll be expensive to do it from scratch. The doc i gave above uses ingestion pipeline to upsert the embedded documents hence i don’t have any manual control on the vectors upserted and the its meta-data unlike the ones in the documentation.
1 post - 1 participant