OpenAtlas

Eugen Hotwagner wrote:

Bernhard Koschiček-Krombholz wrote:

Eugen, I assign this ticket to you. If you have test everything and found more problems, please assign it back to me with your feedback.
Newest version in swaggerhub: https://app.swaggerhub.com/apis/ctot-nondef/OpenAtlas/0.3/

I only had time to do a preliminery check but the problem seems to persist. Did you check if the data payload conforms to the api using any of those tools https://openapi.tools/#data-validators ?

If yes, then the problem is most likely on my side and i will investigate further.

Upon reading a bit more, i think that many code generators are not able to deal with "oneof". Might be the issue.

Interesting i can delete a post but uploaded files are still there :)

Without oneof i indeed get responses with payloads. I think that you should use oneofs. It is not that much work to modify the client to fix that. Maybe mentioning that in the api documentation is sufficient. It is unfortunate that swaggerhug generates brokent clients that fail silently on these methods.

I also encountered some deserialization errors that might hint that the json payload does not conform to the api. But maybe thats just the no oneof fork.

You are right, we will keep the oneofs, but for debugging reasons, I will keep the additional swagger documentation.

I think I found the bug from the deserialization errors: the key of the TimespansModel was wrong ("first" not "start") This was a relic of an older version. Please try it again.

I'm happy that we are moving forward, thank you again for the constructive feedback!

@ @Eugen Hotwagner:
Completely unrelated to your discussion, but about file deletion: you should be able to delete them not in the note but at the bottom of the yellow information area above in the Files section with a little trashcan icon.
If not, please tell me which you want to be deleted (both?) and I can do it for you.

Is it working now as expected? If yes can you (Eugen) please close the issue?

Sorry for the long delay. I still encounter deserialization errors.
@"Error: Newtonsoft.Json.JsonSerializationException: Cannot deserialize the current JSON object (e.g. {"name":"value"}) into type 'Microsoft.FSharp.Collections.FSharpList`1[OAAPI.Types.WhenModel]' because the type requires a JSON array (e.g. [1,2,3]) to deserialize correctly.
To fix this error either change the JSON to a JSON array (e.g. [1,2,3]) or change the deserialized type so that it is a normal .NET type (e.g. not a primitive type like integer, not a collection type like an array or List<T>) that can be deserialized from a JSON object. JsonObjectAttribute can also be added to the type to force it to deserialize from a JSON object.

@ "when": {
"timespans": [ {
"start": {
"earliest": "None",
"latest": "None"
},
"end": {
"earliest": "None",
"latest": "None"
}
}
]
}@

The problem seems to be here, but not sure why?

WhenModel:
      properties:
        timespans:
          items:
            $ref: '#/components/schemas/TimespansModel'
          type: array
      type: object

TimespansModel:
      properties:
        end:
          $ref: '#/components/schemas/TimeDetailModel'
        start:
          $ref: '#/components/schemas/TimeDetailModel'
      type: object

Not sure if relevant but swaggerhub gives this:

@ "when": [ {
"timespans": [ {
"end": {
"earliest": "string",
"latest": "string"
},
"start": {
"earliest": "string",
"latest": "string"
}
}
]@

as a possible example for the api which looks like an array of an array.

Changed the models to:

    TimeDetailModel:
      properties:
        earliest:
          type: string
        latest:
          type: string
      type: object
    TimeStartEndModel:
      properties:
        end:
          $ref: '#/components/schemas/TimeDetailModel'
        start:
          $ref: '#/components/schemas/TimeDetailModel'
      type: object
    TimespansModel:
      items:
        $ref: '#/components/schemas/TimeStartEndModel'
      type: array
    WhenModel:
      properties:
        timespans:
          $ref: '#/components/schemas/TimespansModel'
      type: object

This should be working. I will try to get another look at the tools you presented. I couldn't run the python tools properly.

Thanks, i will try the new version later.

@data validation tools (https://openapi.tools/#data-validators). I ran https://github.com/KissPeter/APIFuzzer which is very interesting but it was not very useful. The problem is that it concentrates on the request space and finds many "problems" that are right now not handled in that part of the api but by error handling. For example some input should only be an integer but is defined as number in the api so the fuzzer will test floats and get back an defined error. Or another is defined as a general string, where it can only be some well defined possibilities and reports errors if something else is used. Now, OpenApi has tools to tighten types much more and i have seen some examples in the API but i do not know how clever and powerful APIFuzzer is. Trying to tighten (put constraints on) the types of input requests might make this tool quite useful. Making partial functions into total functions and illegal states unrepresentable.

Of more immediate usefulness should be https://github.com/p1c2u/openapi-core where the above error should have been caught with a test by comparing the response with the spec.

Still persists. I think the problem lies here:

    FeatureGeoJSON:
      properties:
...
        when:
          items:
            $ref: '#/components/schemas/WhenModel'
          type: array

which is why the specs define an array:

 "when": [
        {
          "timespans": [
            {
              "end": {
                "earliest": "string",
                "latest": "string" 
              },
              "start": {
                "earliest": "string",
                "latest": "string" 
              }
            }
          ]

 "when": {
            "timespans": [
              {
                "start": {
                  "earliest": "None",
                  "latest": "None" 
                },
                "end": {
                  "earliest": "None",
                  "latest": "None" 
                }
              }
            ]
          }

I also found two other possible issues:

The without oneof branch uses a oneof here:

    GeometryModel:
      properties:
        coordinates:
          items:
            oneOf:
              - type: integer
              - items:
                  type: integer
                type: array

and you specify some responses as dictionaries

            application/ld+json:
              schema:
                $ref: '#/components/schemas/OutputModelLPF'
          description: A dictionary with a result dictionary and pagination information

that you dont use.

Hmm, the problem persists when i change the specs to

          "when": {

              "$ref": "#/components/schemas/WhenModel" 

          }

but no real clue if i am doing it right.

Got it, there was a second instance of the issue:

RelationModel:
      properties:
        label:
          type: string
        relationDescription:
          type: string
        relationSystemClass:
          type: string
        relationTo:
          type: string
        relationType:
          type: string
        type:
          type: string
        when:
          items:
            $ref: '#/components/schemas/WhenModel'
          type: array
      type: object

Works fine if the array is removed.

The same problem seem to exist with features/geometry. Removing the array fixes it.

Thank you, is fixed in swaggerhub.

What is the status of this question? Can we close it?