Is your feature request related to a problem? Please describe.
Currently, the Decidim export files for the “download my data” feature do not offer all the data collected by the platform, due to the addition of new functionalities in recent years that generate new data. Therefore, it is necessary to update the CSV export files functionality so that it can collect all the user generated data on the platform.
Describe the solution you'd like
All models and their fields created by participants will be reviewed, and a comparison will be made to determine which of these are currently available in the CSV export files. If any fields are found to be unavailable, the addition of these models and/or fields to the CSV files will be developed.
In particular, we’re missing the Meetings generated by the participant, as that was added in the last years.
Describe alternatives you've considered
To have some kind of contract in the models/schemas that could ease-up this kind of discovery of new fields.
To have a better review process when we introduce new fields.
To have a CI mechanism to detect when there’s a new table/column in the database so we can allow-list this new field (after it was added in the CSVs/API).
To regularly make this same task (yearly or every two years)
Additional context
This is related to other issues, as the problem is the same. The main difference is that:
And this particular issue is focusing on only the user generated data available in the “download my data” page
Does this issue could impact on users private data?
Potentially, as it’s user generated data, but is for data generated by this particular participant
Acceptance criteria
Is your feature request related to a problem? Please describe.
Currently, the Decidim export files for the “download my data” feature do not offer all the data collected by the platform, due to the addition of new functionalities in recent years that generate new data. Therefore, it is necessary to update the CSV export files functionality so that it can collect all the user generated data on the platform.
Describe the solution you'd like
All models and their fields created by participants will be reviewed, and a comparison will be made to determine which of these are currently available in the CSV export files. If any fields are found to be unavailable, the addition of these models and/or fields to the CSV files will be developed.
In particular, we’re missing the Meetings generated by the participant, as that was added in the last years.
Describe alternatives you've considered
To have some kind of contract in the models/schemas that could ease-up this kind of discovery of new fields.
To have a better review process when we introduce new fields.
To have a CI mechanism to detect when there’s a new table/column in the database so we can allow-list this new field (after it was added in the CSVs/API).
To regularly make this same task (yearly or every two years)
Additional context
This is related to other issues, as the problem is the same. The main difference is that:
And this particular issue is focusing on only the user generated data available in the “download my data” page
Does this issue could impact on users private data?
Potentially, as it’s user generated data, but is for data generated by this particular participant
Acceptance criteria
Given that I’m a reviewer,
I have a CSV file for each module with all the fields from the generated db/schema.rb of the development_app
With the columns
table, column, csv_published, csv_to_be_published.The models:decidim-core#13960decidim-meetings#13959decidim-core#13960decidim-core#13960decidim-core#13960decidim-initiatives#13961decidim-meetings#13959decidim-meetings#13959decidim-core#13960decidim-core#13960decidim-proposals#13958decidim-meetings#13959decidim-core#13960decidim-core#13960Given that I’m a user,
And I have created content in any of these models
And I click in the “Download my data” button,
Then I can see new fields in this generated file (if there’s any)
Given that I’m a user,
And I have created a new Meeting
And I click in the “Download my data” button,
Then I can see this new file with the data provided by me