Artificial Intelligence AI Questions

Best way to learn is ask creative questions. Questions  GAI: with llms does it matter what order the tokens are passed through the neural net? Yes, the order of tokens passed through an LLM absolutely matters. While Transformers are designed to process tokens in parallel, they rely on specific mechanisms to […]

Artificial Intelligence AI LLM Large Language Models Table of Contents TOC

Artificial Intelligence AI LLM Large Language Models Table of Contents TOC Artificial Intelligence AI LLM Large Language Models Table of Contents TOC Page Search: eXtP7rp —————————————————————————————————— Artificial Intelligence AI Questions – Creative questions to accelerate learning Local Artificial Intelligence AI Search On a Website OpenAI Embeddings and Vector Databases Crash Course […]

OpenAI Embeddings and Vector Databases Crash Course

Summary

A quick run thru of vectorized databases.   He goes a bit quick.   Looks like the video is from 2 years ago so the free online tools he used might not still be available.  Might have to substitute others.

  • Demonstrates how words and phrases can be vectorized –  { how does this process get done? Math please }  – he uses OpenAI to generate.
  • Demonstrates storing vectorized phases into a vector database that consists of:   Phrase ,  Vectorized ( Phrase ) —> SQL:  Text , Blob 
  • Creates a search phrase –> Vectorize ( search phase ) and use it to search against the SQL Vectrorized ( Phrase ).  The search results are returned in descending order of match.  { how does the match get calculated?} 

Tools Used

  • Postman
  • GAI: what is postman software
  • Postman is a widely used API (Application Programming Interface) development platform that allows developers to design, build, test, document, and share APIs. It acts as an API client, enabling users to send various HTTP requests (GET, POST, PUT, DELETE) to web services and analyze responses, supporting REST, SOAP, and GraphQL. 
  • GAI: is there an open source version of postman for ubuntu
  • Yes, there are several open-source, offline-friendly Postman alternatives for Ubuntu that offer similar API testing functionality without requiring cloud accounts. The top recommendations include Bruno, Hoppscotch, and Insomnium, all of which are cross-platform and available on Linux.  ( ….more ) 

Research Links

Local Artificial Intelligence AI Search On a Website

Research Links


Here is the step-by-step process for the easiest local setup:

1. Set Up Your Local Environment

  • Install Local (formerly Local by Flywheel): Download and install Local. This software allows you to run a WordPress site on your laptop without any web connection.
  • Import Your Site: Drag and drop your WordPress backup file (.zip from Duplicator, All-in-One Migration, or WP Vivid) onto the Local app to create an offline, local copy. 

2. Implement Local Vector Search

Install a Semantic Search Plugin: Inside your local WordPress dashboard, install a plugin that supports vector embeddings.

  • AI Vector Search (Recommended for Easiest): This plugin allows you to run search locally out of the box ("Lite Mode").
  • WPSOLR: Good for indexing content locally using Docker containers.
  • Vectorize Content: Go to the plugin’s settings and click "Index" or "Re-index." The plugin will convert your post content into vectors (embeddings) and store them in your local MySQL database. 

3. (Optional) Enhance with Local LLM (True Local AI)

To make it "totally local" (meaning no OpenAI API), you can connect the plugin to a local model runner:

  • Ollama: Install Ollama on your machine to run open-source models like Llama 3 or Mistral locally.
  • Connect Vector Search: Configure the AI Vector Search plugin to use Ollama for generating embeddings instead of an API. 

Summary of Tools

  • Environment: Local (LocalWP).
  • Plugin: AI Vector Search (Semantic).
  • Search Engine: Local MySQL or Dockerized Weaviate/Solr. 

This setup ensures that all your data stays on your machine, no external API calls are made, and your search functionality remains active without internet access.