Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Levee data set two sides #1528

Open
rpachaly opened this issue Aug 30, 2024 · 14 comments
Open

Levee data set two sides #1528

rpachaly opened this issue Aug 30, 2024 · 14 comments
Assignees
Labels
bug ready for testing Issue fixed and waiting to be tested

Comments

@rpachaly
Copy link
Collaborator

Data for the levees set two sides (grid 24959) to 897.3336 below the 936 m of WSE in this lesson, see below. The project domain gets completely inundated by the water release through this hole.

image

@rpachaly rpachaly added the bug label Aug 30, 2024
@rpachaly rpachaly self-assigned this Aug 30, 2024
@rpachaly
Copy link
Collaborator Author

rpachaly commented Sep 4, 2024

@FLO-2DKaren I'm working on this and trying to figure out the bug. The bug seems to be related to the moving window, again. I'm not pretty sure, but it seems that the center of each corner of the moving window is on the center of the grid. That's why usually some of the levees directions are problematic and others don't. I added an inner loop that gets all levees in a grid and it seems to have solved our problem without increasing significantly the computational time.

In my testing, the new code is better on the testing that I did on the self help kit and on the tailings dam project. However, the big wall tests the results are different, with the new code looking more correct. We need to figure out a good way of testing this.

I think in the future we will need to revisit and refactor this levee code, it is a bunch of small and weird adjustments.

I'll do a little bit more of testing before pushing the branch.

@rpachaly
Copy link
Collaborator Author

rpachaly commented Sep 4, 2024

Ok, I did a bunch of testing and the new code is better and correct. It is merged on #1539.

Check this comparison on the BigWallTest. The current code exports a lot of -9993 which is wrong. The modified code fixed that and it is exporting correctly for all the testing that I did. Karen, when you are doing your testing on this, please look for these negative values.

image

@rpachaly rpachaly added the ready for testing Issue fixed and waiting to be tested label Sep 4, 2024
@FLO-2DNoemi
Copy link

FLO-2DNoemi commented Sep 4, 2024 via email

@FLO-2DKaren
Copy link
Collaborator

Let's add a moving window checkbox. So you only use that method if you actually have large data.

@FLO-2DKaren
Copy link
Collaborator

FLO-2DKaren commented Sep 7, 2024

@rpachaly
Please watch this video with respect to the self help kit. I'm setting up the big wall test next.
https://flo-2d.sharefile.com/d-s4f79d07aa8174c5fbb3ed8d16b27dad7

I wonder if one of the variables that's used to calculate elevation is coming from the schema layer instead of the user layer. We should study which of those variables are being used when it enters the second window. Maybe it's not the window code but the cleanup code that's causing this issue.

For example what if there was a catch all for missing data that used the schema data instead of the user data to finish the calculation. That would cause the levee crest to be doubled because it's not null in the schema layer but it still sees the coorection.

@FLO-2DKaren
Copy link
Collaborator

hmmm I did the big wall test and all of mine came out -9993.

@FLO-2DKaren
Copy link
Collaborator

image

@FLO-2DKaren
Copy link
Collaborator

Well good news. Because I didn't have elevation in my BigWall test, I was able to see the issue more clearly.

  1. Let's add a Clip Line Features to the Moving Window code when we process the line data. We can store the clip in a temp file and then throw it away.

There are now 3 videos to review.

@FLO-2DKaren
Copy link
Collaborator

Just a note that this issue is still open and valid.

@FLO-2DNoemi
Copy link

FLO-2DNoemi commented Nov 1, 2024 via email

@rpachaly
Copy link
Collaborator Author

rpachaly commented Nov 4, 2024

Hi all,

I have not received the latest comments on this issue, I don't know why. I'll work on this.

@rpachaly rpachaly removed the ready for testing Issue fixed and waiting to be tested label Nov 18, 2024
@FLO-2DKaren
Copy link
Collaborator

Try using sqlite processing instead of multiple grid intersections.

@FLO-2DKaren
Copy link
Collaborator

K Test this with points and polyline method.

@rpachaly
Copy link
Collaborator Author

I changed the current code that was using the moving window to a simpler sqlite processing and it is working fine. I tested on many projects and all seems good and fast. Done and merged on #1624

@rpachaly rpachaly added the ready for testing Issue fixed and waiting to be tested label Jan 14, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug ready for testing Issue fixed and waiting to be tested
Projects
None yet
Development

No branches or pull requests

3 participants