OpenAtlas

I tested some performance with Thanados data. Besides some operations are being slow due high linkage, I found another performance issue.
Views and API calls in Thanados always take at a minimum of 3 seconds. In fact, it takes 3 seconds that the view/API code is even reached. So I looked into the __init__.py and found the two baddies:

g.file_stats = get_file_stats()
~ 1.5 seconds (Thanados has over 17.000 files)

g.types = Type.get_all()
~ 1.15 seconds (Thanados has 3853 types)

These two are responsible for the delay.

Can be tested with a bigger project data set when e.g. calling:
http://localhost:5000/api/0.3/query/?system_classes=all&format=lp&column=name&sort=asc&limit=0

Today we looked into Type.get_all() at __init__.py and it looks like most of the cost comes from determining the count for entities using that type.
Next session we will try to make a switch at Type.count_all() to only get counts when needed (e.g. at type views).