feat/backfill db - #1986
Open
alanpeixinho wants to merge 18 commits into
Open
Conversation
Part of kernelci#1948 Signed-off-by: Alan Peixinho <[email protected]>
Part of kernelci#1948 Signed-off-by: Alan Peixinho <[email protected]>
* For analysis queries we are going for lab column information
first, and coalescing to json misc information.
* All COALESCE expressions are marked with TODO comments for removal
after the lab_id backfill is complete.
Closes kernelci#1948
Signed-off-by: Alan Peixinho <[email protected]>
Signed-off-by: Alan Peixinho <[email protected]>
Signed-off-by: Alan Peixinho <[email protected]>
Signed-off-by: Alan Peixinho <[email protected]>
Rename Builds/Tests FK field from lab to lab_id so lab is free for annotated lab names without conflicting with the ORM relation. Signed-off-by: Alan Peixinho <[email protected]>
Keep lab as the standard Django FK field and resolve build test lab names via raw SQL, matching the hardware query pattern. Signed-off-by: Alan Peixinho <[email protected]>
Enforce the lab FK db_constraint on builds and tests, drop the unused lab_id from the build tests response, and fix the tree query lab TODO. Signed-off-by: Alan Peixinho <[email protected]>
Signed-off-by: Alan Peixinho <[email protected]>
* chore: set default pre-commit install hooks Signed-off-by: Luiz Georg <[email protected]> * chore: update pre-commit hooks Signed-off-by: Luiz Georg <[email protected]> * chore: limit frontend pre-commit hooks to frontend changes Signed-off-by: Luiz Georg <[email protected]> --------- Signed-off-by: Luiz Georg <[email protected]>
* refactor: right align metrics email Readjusts the email formatting so that the larger number sections have a right-aligned text Part of kernelci#1938 Signed-off-by: Marcelo Robert Santos <[email protected]> * feat: use dynamic spacing on metrics email Calculates the space required for the data and labels within jinja to avoid empty spaces or crammed values in the Coverage and Test Labs Activity sections It is possible to do it in Python but then we would need the fmt macro outside as well. A value such as 1000 might count as 4 chars in python but it is displayed as a 5-char 1,000 in jinja. Also, these spaces only make sense for the jinja template anyway, so I think it is correct to keep them within it. Signed-off-by: Marcelo Robert Santos <[email protected]> * refactor: right align build regressions in metrics email Closes kernelci#1938 Signed-off-by: Marcelo Robert Santos <[email protected]> --------- Signed-off-by: Marcelo Robert Santos <[email protected]>
…#1924) (kernelci#1955) * feat: remove checkout filtering in /trees (kernelci#1924) This filter was filtering very little in practice, and querying every lastest checkout is very cheap. Signed-off-by: Luiz Georg <[email protected]> * feat: add an indicator for the time filtering in /hardware (kernelci#1924) Closes: kernelci#1924 Signed-off-by: Luiz Georg <[email protected]> * fixup! feat: remove checkout filtering in /trees (kernelci#1924) this change was out of scope and requires further investigation Signed-off-by: Luiz Georg <[email protected]> * amend! feat: add an indicator for the time filtering in /hardware (kernelci#1924) feat: add a label to indicate hidden filtering filtering (kernelci#1924) Closes: kernelci#1924 Signed-off-by: Luiz Georg <[email protected]> * fixup! feat: add an indicator for the time filtering in /hardware (kernelci#1924) Signed-off-by: Luiz Georg <[email protected]> --------- Signed-off-by: Luiz Georg <[email protected]>
* chore(backend): generate pending schema changes Pending schema changes from commit 5ef7b2b Signed-off-by: Felipe Bergamin <[email protected]> * feat(backend): add last seen to issue details Part of kernelci#1956 Signed-off-by: Felipe Bergamin <[email protected]> * feat(dashboard): show last seen on issue details page Closes kernelci#1956 Signed-off-by: Felipe <[email protected]> --------- Signed-off-by: Felipe Bergamin <[email protected]> Signed-off-by: Felipe <[email protected]>
Fixes test error introduced in commit 775769f Signed-off-by: Luiz Georg <[email protected]>
* process historical data to use the lab foreign key Signed-off-by: Alan Peixinho <[email protected]>
Leave lab_id NULL for shell/k8s* and misc.automatic_lab so backfill matches ingest _real_lab and does not insert fake labs. Signed-off-by: Alan Peixinho <[email protected]>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
4 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
what it is
Includes a backfill labs command to update old data into using the lab foreign key for builds and tests tables.
How to test