An Effective Framework to Help Large Language Models Handle Numeric-involved Long-context Tasks