Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Reuse/Replicate SemanticAnalyzer and Enhancer to Agent workflow #811

Open
wants to merge 8 commits into
base: main
Choose a base branch
from
Open

Reuse/Replicate SemanticAnalyzer and Enhancer to Agent workflow #811

wants to merge 8 commits into from
+130 −16

Conversation

DonggeLiu
Copy link
Collaborator

@DonggeLiu DonggeLiu commented Feb 21, 2025 •
edited
Loading

  1. Reuse SemanticAnalyzer from the one-prompt workflow
  2. Replicate Enhancer from OnePromptEnhancer
  3. Last result can still be BuildResult if build failure.
  4. When Execution Fails, still record BuildResult without RunResult.
  5. Download xs benchmarks to understand why its successful BuildResult was not recorded on final experiment report after its run failure.
  6. Clean up commented code.
  7. Do not print chat_histroy when logging Results, which makes it unreadable.
  8. Stringify WorDirs.

Next:

  1. Fix log type for easier debugging.
  2. Understand and fix prompt truncation logic error.
  3. Re-run cloud build if a flaky step failed (e.g., apt install).

@DonggeLiu DonggeLiu marked this pull request as draft February 21, 2025 00:30
@DonggeLiu
Copy link
Collaborator Author

/gcbrun exp -n dg -ag

@DonggeLiu
Copy link
Collaborator Author

/gcbrun exp -n dg -ag

@DonggeLiu
Copy link
Collaborator Author

/gcbrun exp -n dg -ag

@DonggeLiu
Copy link
Collaborator Author

/gcbrun exp -n dg1 -ag

@DonggeLiu DonggeLiu marked this pull request as ready for review February 23, 2025 08:17
@DonggeLiu
Copy link
Collaborator Author

/gcbrun exp -n dg2 -ag

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@oliverchang oliverchang Awaiting requested review from oliverchang

@mihaimaruseac mihaimaruseac Awaiting requested review from mihaimaruseac

At least 1 approving review is required to merge this pull request.

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@DonggeLiu