Skip to content
PodSubs
ShowsPeopleGuestsJobsNewsEvents
More
BlogPodCred
Menu
ShowsPeopleGuestsJobsNewsEventsBlogPodCredNetworksSign in
Join nowSign in
  • Shows
  • People
  • Jobs
  • News
  • More
    • Guests
    • Events
    • Blog
    • PodCred
    • Networks
    Join nowSign in

DEV

DEV artwork

Private RAG Over Microsoft 365: Permissions, Delta Queries, and What Actually Ships

Nov 11, 20265 minAudio

Enterprise teams keep hitting the same wall when grounding LLMs on SharePoint and OneDrive: a working prototype that fails the moment security asks who actually owns access to the returned content. This episode of DEV.co examines the architecture behind a permission-aware, production-grade RAG system over Microsoft 365 - drawing on the team's deep-dive article on private RAG over Microsoft 365 - and maps out exactly where complexity lives and how to handle it correctly from the start. The episode covers the full stack of decisions engineering teams face when moving beyond the demo, including: Delta queries and change tracking: How to use the Microsoft Graph delta endpoint to incrementally sync content - additions, modifications, and deletions - without expensive nightly full recrawls. Scoping Graph permissions correctly: Why Sites.Read.All is a zero-trust red flag and how Sites.Selected with explicit site allow-listing is what actually clears a security review. Entra ID object IDs over UPNs: User principal names break when accounts are renamed or deprovisioned; stable object IDs are the right identity anchor for downstream permission filtering. ACL-trimmed retrieval: Materializing effective ACLs as fields on each index record and filtering every query against the caller's resolved group memberships before results are returned - the step most prototypes skip, and the reason overshared files become overshared vectors. Teams building production RAG pipelines need this baked in, not bolted on. Format-aware parsing: The M365 corpus is not just Word docs - spreadsheets, OneNote sections, PowerPoint files, and SharePoint page markup all require distinct parsing logic, and retrieval format support varies significantly across surfaces. Choosing a retrieval surface: A practical comparison of three real options - the Copilot Retrieval API (native ACLs, zero egress), Azure AI Search with security filters (full chunking control), and a fully custom pgvector or Qdrant index (maximum control, maximum ownership) - with guidance on which fits which stage of maturity. Cybersecurity considerations are woven throughout, including the OWASP 2025 LLM Top 10's new vector and embedding weakness category covering data poisoning, embedding inversion, and cross-user context leakage. For more on how ingestion pipeline decisions shape the security boundary of an AI system, the episode Why Your LLM Ingestion Pipeline Is Your Real Security Perimeter covers closely related ground and pairs well with this one. DEV.co RFP.co

Audio and video play straight from the show's own hosting. PodSubs stores and serves no media.

Hosts and Guests

Nobody is credited on this episode yet.

Credit the people on this episode

Be the first to rate this episode

More episodes

All episodes
  1. The U.S. Has More Data Centers Than the Next 14 Countries Combined

    Nov 20, 20265 minAudio

    The global data center map looks lopsided by any measure - but the full picture is more striking than a simple site count suggests. This episode of DEV.co digs into a newly published graphic analysis showing just how...

    Credit the people on this episode

  2. From $30 Million to $5 Billion: The AI App Explosion by the Numbers

    Nov 18, 20265 minAudio

    The generative AI app market has posted one of the most dramatic growth curves in consumer software history - and the numbers behind that curve reveal a story far more nuanced than the headline figure suggests. This...

    Credit the people on this episode

  3. AI Adoption: Why the Numbers Are So Far Apart

    Nov 15, 20265 minAudio

    A single statistic can make AI feel like a done deal - nearly every organization already on board, the window to act almost closed. But a competing figure from the U.S. Census Bureau tells a starkly different story....

    Credit the people on this episode

  4. 83% of Developers Use AI Tools — But Only 6.6% Actually Trust Them

    Nov 13, 20265 minAudio

    Widespread AI adoption among software developers is no longer a trend to watch - it's the current reality. But a sweeping Stack Overflow survey of nearly 31,000 developers reveals a striking contradiction at the heart...

    Credit the people on this episode

  5. Why Your LLM Ingestion Pipeline Is Your Real Security Perimeter

    Nov 8, 20265 minAudio

    Security teams building LLM-powered products tend to focus on output filters and prompt guardrails - but those controls arrive too late. The document ingestion pipeline is where sensitive enterprise data is processed,...

    Credit the people on this episode