All projects
Generative AI & LLMs

Paraphrase Geometry for Embedding Enhancement

Ongoing

CSP: an ongoing training-free, model-agnostic method that refines sentence embeddings at inference time using paraphrase geometry.

Paraphrase-geometry embedding refinement (CSP)

The idea

Sentence embeddings power semantic search, retrieval-augmented generation and clustering — but even strong encoders often confuse surface-form overlap with true meaning. This ongoing project (CSP — Semantic Constraint-Specific Projections) treats a sentence's paraphrases as samples of a local, meaning-preserving manifold, and uses the geometry those paraphrases trace out to refine the embedding.

Why it matters

It all happens at inference time — no labels, no extra training, and compatible with any frozen encoder — aiming for the kind of gains contrastive fine-tuning gives, but without the training cost or the loss of generality, which matters in privacy-, latency- or IP-constrained deployments. (Method details are held back while the work is under submission.)

Tech stack & key skills

Core tools, methods and skills demonstrated in this project:

Sentence embeddingsPEGASUS paraphrasingLinear-algebra projectionsZero-shot inferenceRetrieval / RAGNumPy