Updates to make this work properly with the latest pinecone and openai

[eharvey71]

Made some updates, mostly to the pinecone service module. This wasn't working for me and I've corrected the following:

• pinecone.init() is no longer supported, it appears. I've updated to a new intantiation and import.
• Importing ServerlessSpec as it was not working for me without specifying this during Pinecone instantiation.
• pinecone.list_indexes().names() method is required and the index deletion wasn't working without it.
• Use of question_embedding when getting similar chunks wasn't working without specifying 'vector=' in the query arguments. Otherwise, it complains about the top_k placement for some weird reason.
• Added a user-agent in the header when scraping with BS4. Some sites deny access without it.
• Updated create_app() a little bit for CORS handling.
• A big one problem that can be very elusive: if you have an OpenAI account with pay-as-you-go. The GPT-4 preview won't work if you haven't added funds and checked the OpenAI sandbox prior to using this tutorial!

[vinayakgavariya]

hey @eharvey71 is it working fine for you after changes?

[eharvey71]

hey @eharvey71 is it working fine for you after changes?

It is! I just tested again today against different sites and all appears to be working.
The only very weird caveat (and what caused it to fail initially for me) is that an empty dictionary is returned until you go into your openai account (personal, in my case) and set up a random playground assistant, selecting the GPT-4 preview model. Trying again after giving it that "kick" seems to always fix the problem.

[vinayakgavariya]

awesome!

I have azureopenai api key and I am wondering how I can use it instead of openai api key and if it will work or not.

would love to know if you are aware of it.

[eharvey71]

Ah, that would be interesting to try. I don't have Azure credentials, though. Good luck giving that a shot!

…

On Thu, Jan 25, 2024 at 2:21 AM vinayak gavariya ***@***.***> wrote: awesome! I have azureopenai api key and I am wondering how I can use it instead of openai api key and if it will work or not. would love to know if you are aware of it. — Reply to this email directly, view it on GitHub <#1 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AAH6LD3QH5ZDADHRPVGJNNTYQIBWNAVCNFSM6AAAAABCCKPKDKVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTSMBZGQ4DMMRUGE> . You are receiving this because you were mentioned.Message ID: ***@***.***>

-- Eric Harvey 804-647-7522

[CamiloJac]

Should this be pinecone instead of pinecome

[vinayakgavariya]

yes

[eharvey71]

Just tested again and all seems well with my pull request. Can someone review?

[ashnkumar]

@eharvey71 — this is long overdue and I'm sorry. I stopped watching this repo after the posts went out, and your review request went past me. Thank you for doing the work, for coming back twice to confirm it still ran, and for helping @Roy-Praveen in #2 while I wasn't around. That's more than anyone owes someone else's tutorial repo.

I'm going to leave main where it is rather than merge, and the reason is narrow: the two Medium posts walk through this code line by line, so if main moves, the tutorial stops matching what a reader sees on the page.

Your diagnosis is right, though, and it's what most people landing here actually need. So I've added a note at the top of the README that says plainly what's broken and why, and points readers at this PR and at you.

Closing it so it isn't sitting open indefinitely — it stays readable and linkable, which is how the README references it. Thanks again for taking the time.