Skip to content

Derek furst/jobq bulk ids #999

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
yuanzhou merged 2 commits into from
Apr 1, 2026
+6 −13
Merged

Derek furst/jobq bulk ids #999

Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
593f6aa
wip: updated logic for batch ids query
DerekFurstPitt Mar 27, 2026
ace7caa
updated query to massively improve the speed of fetching metadata by …
DerekFurstPitt Mar 31, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
19 changes: 6 additions & 13 deletions src/app_neo4j_queries.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -1198,19 +1198,12 @@ def get_entities_by_uuid(neo4j_driver,
"""
def get_batch_ids(neo4j_driver, id_list):
query = """
MATCH (e)
WHERE e.uuid IN $id_list OR e.hubmap_id IN $id_list
WITH e, [id IN $id_list WHERE id = e.uuid OR id = e.hubmap_id][0] AS original_id
RETURN original_id, e.uuid AS uuid, e.hubmap_id AS hubmap_id
MATCH (e:Entity)
WHERE e.uuid IN $id_list
RETURN apoc.map.fromPairs(COLLECT([e.uuid, e.hubmap_id])) AS result
"""

result_map = {}

with neo4j_driver.session() as session:
result = session.run(query, id_list=id_list)
for record in result:
result_map[record['original_id']] = {
"uuid": record['uuid'],
"hubmap_id": record['hubmap_id']
}
return result_map
record = session.run(query, id_list=id_list)
raw = record.single()["result"]
return {uuid: {"uuid": uuid, "hubmap_id": hubmap_id} for uuid, hubmap_id in raw.items()}
Loading