Learning to Prune: Speeding up Repeated Computations
Abstract
It is common to encounter situations where one must solve a sequence of similar computational problems. Running a standard algorithm with worst-case runtime guarantees on each instance will fail to take advantage of valuable structure shared across the problem instances. For example, when a commuter drives from work to home, there are typically only a handful of routes that will ever be the shortest path. A naive algorithm that does not exploit this common structure may spend most of its time checking roads that will never be in the shortest path. More generally, we can often ignore large swaths of the search space that will likely never contain an optimal solution. We present an algorithm that learns to maximally prune the search space on repeated computations, thereby reducing runtime while provably outputting the correct solution each period with high probability. Our algorithm employs a simple explore-exploit technique resembling those used in online algorithms, though our setting is quite different. We prove that, with respect to our model of pruning search spaces, our approach is optimal up to constant factors. Finally, we illustrate the applicability of our model and algorithm to three classic problems: shortest-path routing, string search, and linear programming. We present experiments confirming that our simple algorithm is effective at significantly reducing the runtime of solving repeated computations.
Additional Information
This work was supported in part by Israel Science Foundation (ISF) grant #1044/16, a subcontract on the DARPA Brandeis Project, and the Federmann Cyber Security Center in conjunction with the Israel national cyber directorate.Attached Files
Submitted - 1904.11875.pdf
Files
Name | Size | Download all |
---|---|---|
md5:8b6023920f9cd9bfcf11ff9c4827b530
|
2.0 MB | Preview Download |
Additional details
- Eprint ID
- 96752
- Resolver ID
- CaltechAUTHORS:20190626-145729225
- 1044/16
- Israel Science Foundation
- Defense Advanced Research Projects Agency (DARPA)
- Hebrew University of Jerusalem
- Created
-
2019-06-26Created from EPrint's datestamp field
- Updated
-
2023-06-02Created from EPrint's last_modified field