Project

General

Profile

Actions

Feature #2492

closed

Performance improvement

Added by Alexander Watzinger 10 months ago. Updated 9 months ago.

Status:
Closed
Priority:
Normal
Category:
Backend
Target version:
Start date:
2025-03-09
Estimated time:

Description

With growing datasets, performance improvements are an ongoing task.

When testing with THANADOS which has a dataset of about 200,000 entities and 700,000 links, we noticed that loading the base system could already take a few seconds so we decided to focus on that. Measurements noted here are taken from a locally installed THANADOS instance.

Update
Loading the base systems (model, types, file stats, ...) even with a lot of data could be improved from a couple of seconds to 0.5 seconds (at most views):
  • Skipping model counts where not needed -> improvement to 0.02 seconds instead 1.00 second
  • Skipping type counts at entity default view for none types -> improvement over 1 second when viewing (non type) entities
  • Skipping model loading for image and logo display -> improvement varying but noticeable
  • Improving file stats fetching -> improvement varying but up to 0.5 seconds
  • Improved loading of external reference systems -> improvement up to 0.2 seconds
Actions #1

Updated by Alexander Watzinger 10 months ago

  • Description updated (diff)
Actions #2

Updated by Alexander Watzinger 10 months ago

  • Description updated (diff)
Actions #4

Updated by Alexander Watzinger 10 months ago

  • Description updated (diff)
Actions #5

Updated by Alexander Watzinger 10 months ago

  • Description updated (diff)
Actions #6

Updated by Alexander Watzinger 10 months ago

  • Description updated (diff)
Actions #7

Updated by Alexander Watzinger 10 months ago

  • Description updated (diff)
Actions #8

Updated by Alexander Watzinger 10 months ago

  • Description updated (diff)
  • Status changed from In Progress to Closed

The sessions with @Bernhard Koschiček-Krombholz were very successful and we could improve loading the base systems (with a lot of data) from a couple of seconds to 0.5 seconds (at most views), see description for more details.

This concludes our look into the base loading, next steps will likely be looking at specific slower views and API endpoints.
As always, user feedback about performance issues to help us identify these areas are appreciated.

Actions #9

Updated by Alexander Watzinger 9 months ago

  • Target version changed from 8.12.0 to 8.11.0
Actions

Also available in: Atom PDF