GRACE achieves significant gains on performance and efficiency in prompt optimization by strategically introducing information loss through a dual mechanism of refinement and compression.