Skip to content

[FEATURE] Retrieval pipeline in code doesn’t match the paper #65

@BaoBaoGitHub

Description

@BaoBaoGitHub

Feature Request

In the current codebase, retrieval is implemented as keyword/vector/hybrid/rrf/agentic in MemoryManager.retrieve_mem, but I don’t see the MemScene selection step described in the paper (score MemScenes by max MemCell relevance, select top scenes, then pool Episodes and rerank). Foresight validity filtering also seems only partially applied depending on the path. The paper-like flow appears closer to the evaluation scripts than the main service.

Is this because the production pipeline prioritized a simpler, general retrieval flow while the paper pipeline was only implemented in eval code? Are there plans to bring the MemScene-first retrieval algorithm (and consistent Foresight validity filtering across keyword/hybrid) into the main service?


Use Case

What problem does this feature solve?
Ensure the production retrieval pipeline matches the paper (MemScene selection → Episode pooling/rerank → Foresight validity filtering), so reported results align with actual system behavior.

Who would benefit from this feature?

  • End users (application developers using EverMemOS)
  • Contributors/developers
  • System administrators
  • Other: _________________

Impact

How important is this feature to you?

  • Critical - blocking my use of EverMemOS
  • High - would significantly improve my workflow
  • Medium - nice to have
  • Low - minor enhancement

Would this be a breaking change?

  • Yes, this would break existing functionality
  • No, this is backward-compatible
  • Not sure

Implementation

Are you willing to contribute to this feature?

  • Yes, I can submit a pull request
  • Yes, I can help with testing
  • Yes, I can help with documentation
  • No, but I'm happy to provide feedback

Estimated complexity:
(If you have development experience)

  • Small - minor addition or change
  • Medium - requires some refactoring or new components
  • Large - significant architectural changes
  • Not sure

Checklist

Before submitting, please check:

  • I have searched existing issues and feature requests to avoid duplicates
  • I have provided a clear description of the proposed feature
  • I have explained the use case and problem being solved
  • I have considered potential alternatives

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions