Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Integrated changes from the pb2b angle solution pipeline to handle glitches better #1021

Open
wants to merge 7 commits into
base: g3thwp_template
Choose a base branch
from

Conversation

bbixler500
Copy link

Here are some changes to the angle solution pipeline which should implement the pb2b glitch finding algorithm. I have tested only the analyze method and only on the dataset obs_1713734012_satp1_00010000. On that dataset the algorithm correctly cleans the glitches from the angle solution. More testing on other datasets is needed.

@bbixler500 bbixler500 requested a review from ykyohei October 28, 2024 23:16
sotodlib/hwp/g3thwp.py Outdated Show resolved Hide resolved
Copy link
Contributor

@ykyohei ykyohei left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

As commented, currently this hwp_angle solution pipeline takes significantly long time than the one in master branch. I need to improve it and test it to merge this.

sotodlib/hwp/g3thwp.py Outdated Show resolved Hide resolved
Comment on lines +1538 to +1540
if not result:
mask = np.full(len(diff), False)
dead_rots.append(i)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I finished testing this on all the observations. This is working for most of the observations, but I found some edge cases where this PR performs worse than before. I listed up the obs_ids as follows.
In these obs_ids, I think the glitch removal is failed, and the removal of failed rotation is leading to larger glitch. Could you take a look at these obs_ids? @bbixler500

obs_1714436045_satp1_1111101
obs_1714439875_satp1_1111101
obs_1714443842_satp1_1111101
obs_1714451357_satp1_1111101
obs_1714462951_satp1_1111101
obs_1714470498_satp1_1111101
obs_1714474327_satp1_1111101
obs_1714948989_satp1_1111011
obs_1714979726_satp1_1111011
obs_1731357259_satp1_1111111

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants