efficient nonmyopic batch active search
play

Efficient Nonmyopic Batch Active Search Shali Jiang Gustavo - PowerPoint PPT Presentation

Efficient Nonmyopic Batch Active Search Shali Jiang Gustavo Malkomes Matthew Abbott Benjamin Moseley Roman Garnett NeurIPS 2018 1 Many real problems involve searching for valuable items from a large pool of candidates in an iterative


  1. Efficient Nonmyopic Batch Active Search Shali Jiang Gustavo Malkomes Matthew Abbott Benjamin Moseley Roman Garnett NeurIPS 2018 1

  2. Many real problems involve searching for valuable items from a large pool of candidates in an iterative fashion Drug discovery Materials discovery 2

  3. What is active search 3

  4. What is active search 3

  5. What is active search inference model ( gives probabilities ) Pr( ) 3

  6. What is active search select a point inference model ( gives probabilities ) Pr( ) 3

  7. What is active search select a point Is it positive? inference model ( gives probabilities ) Pr( ) Oracle 3

  8. What is active search select a point Is it positive? inference model ( gives probabilities ) Pr( ) Oracle yes/no 3

  9. What is active search select a point Is it positive? inference model ( gives probabilities ) Pr( ) Oracle yes/no 3

  10. What is active search select a point Is it positive? inference model ( gives probabilities ) Pr( ) Oracle yes/no 3

  11. What is active search select a point Is it positive? inference model ( gives probabilities ) Pr( ) Oracle yes/no 3

  12. What is active search select a point Is it positive? inference model ( gives probabilities ) Identify as many Pr( ) positives as possible in a given number of queries. Oracle yes/no 3

  13. What is active search How? select a point Is it positive? inference model ( gives probabilities ) Identify as many Pr( ) positives as possible in a given number of queries. Oracle yes/no 3

  14. What is active search How? select a batch of points Is it positive? inference model ( gives probabilities ) Identify as many Pr( ) positives as possible in a given number of queries. Oracle yes/no 3

  15. The most straightforward policy one might think of is greedy: —always choose the points with highest probabilities 4

  16. <latexit sha1_base64="dhlwdY5Bj2eM54CTl3G/02ATLGI=">AJ03icfVZbjxs1FJ6W2ybctvDIy6gREqaoMq4AWptN0tVckS9hpJ916PCeJtePxYDu3WsMDgkf+Ab+GV/gD/BvOjCdNYieMlOTkfN85c3wutuM8ZUofHPx76/Zb7/z7nt7jeb7H3z40cf7dz65UGIiKZxTkQrZj4mClGVwrplOoZ9LIDxO4TK+eVLil1OQionsTC9yGHAytiQUaJRdb3/Vf/lvfDbMCJyxMn82vSL8NWrSMNcG5jnQDUkYdTKhWKaTUGFLPulCPt3r/dbBw8Oqif0hU4tIL6V3f2fs9SgSdcMg0TYlSV52DXA8MkZrRFIpmNFGQE3pDRnCFYkY4qIGpFliEn6MmCYdC4ifTYaVdtzCEK7XgMTI50WPlYqVyG3Y10cNvBoZl+URDRu2LhpM01CIsxUmTGIO0gUKhErMAQ3pmEiCeZGqufGaRJWxbSzExELcaBIrR8s3/5N0JND32FfnCiaYNZFsJsioSUxJXlZwUz+TJB+yESozmFHBOckSEw3ZvDARxLjQok0R8/7hUNBeYNyfHjpUuIuMmJuh7Qt4DnNJ5bYO4Bry3w2gNiC8QeQC1APWBhgYUHzCw84CpBaYeQNJ8TEpQpEnZTSI1kdW5TMFh5DKtzmXyiUNDhcs5ZTh7Ds3qHGZPijJBPVk0NwF+UlVPjylJzYlrxvtrqFelRJZVr4de0gx7qCqW9vGsV95TourzmDlu9XxnBNdroxT89Qzxq5OLeY5HuFeU8bEWeIgh6twDl0rlunEBnS/4khukmJLUIhZGnbBkliykCZhnTgFuou4TsOdQVheuW8qaqIuYEfxAwkxa15m8nJahleuViGHfrStL24tSZKqFIi9wFy1nDeP1hW9SANyF1V/gdMdW1SaTHoL0ufFHbvXCBZ7az7x869oiOtvmb0qWr1sOWzN6CnhISOhin7MQRIt5D1THVIM+wJ/o/ul9H9EMl8SUdpFvCyMOWXO1CgxwKbp6qtOTw+rYPGhAgJ3NS/hTmrhc2zYK5QAneUiFo6P3utIi2kuIV6fFOEmRqPbQdnipWTDQdtysLZ8QsXtHaIwmQLb7GeGWY/F25WxnSEeTFOcZhni5YHjKh5nI+ELkeGQqIHKXYcbyN4s5ft7btRoFP5ebkzEotFGysezKDx3mbxL05Kj3cMXDi0vHvab4wsWXDzo/Sw9ehxfYXZCz4L7gZfBJ3g6+BR8H3QC84DGvwZ/BX8HfzTOG+Yxq+N3yz19q3a5tNg42n8R8LJbd7</latexit> <latexit sha1_base64="dhlwdY5Bj2eM54CTl3G/02ATLGI=">AJ03icfVZbjxs1FJ6W2ybctvDIy6gREqaoMq4AWptN0tVckS9hpJ916PCeJtePxYDu3WsMDgkf+Ab+GV/gD/BvOjCdNYieMlOTkfN85c3wutuM8ZUofHPx76/Zb7/z7nt7jeb7H3z40cf7dz65UGIiKZxTkQrZj4mClGVwrplOoZ9LIDxO4TK+eVLil1OQionsTC9yGHAytiQUaJRdb3/Vf/lvfDbMCJyxMn82vSL8NWrSMNcG5jnQDUkYdTKhWKaTUGFLPulCPt3r/dbBw8Oqif0hU4tIL6V3f2fs9SgSdcMg0TYlSV52DXA8MkZrRFIpmNFGQE3pDRnCFYkY4qIGpFliEn6MmCYdC4ifTYaVdtzCEK7XgMTI50WPlYqVyG3Y10cNvBoZl+URDRu2LhpM01CIsxUmTGIO0gUKhErMAQ3pmEiCeZGqufGaRJWxbSzExELcaBIrR8s3/5N0JND32FfnCiaYNZFsJsioSUxJXlZwUz+TJB+yESozmFHBOckSEw3ZvDARxLjQok0R8/7hUNBeYNyfHjpUuIuMmJuh7Qt4DnNJ5bYO4Bry3w2gNiC8QeQC1APWBhgYUHzCw84CpBaYeQNJ8TEpQpEnZTSI1kdW5TMFh5DKtzmXyiUNDhcs5ZTh7Ds3qHGZPijJBPVk0NwF+UlVPjylJzYlrxvtrqFelRJZVr4de0gx7qCqW9vGsV95TourzmDlu9XxnBNdroxT89Qzxq5OLeY5HuFeU8bEWeIgh6twDl0rlunEBnS/4khukmJLUIhZGnbBkliykCZhnTgFuou4TsOdQVheuW8qaqIuYEfxAwkxa15m8nJahleuViGHfrStL24tSZKqFIi9wFy1nDeP1hW9SANyF1V/gdMdW1SaTHoL0ufFHbvXCBZ7az7x869oiOtvmb0qWr1sOWzN6CnhISOhin7MQRIt5D1THVIM+wJ/o/ul9H9EMl8SUdpFvCyMOWXO1CgxwKbp6qtOTw+rYPGhAgJ3NS/hTmrhc2zYK5QAneUiFo6P3utIi2kuIV6fFOEmRqPbQdnipWTDQdtysLZ8QsXtHaIwmQLb7GeGWY/F25WxnSEeTFOcZhni5YHjKh5nI+ELkeGQqIHKXYcbyN4s5ft7btRoFP5ebkzEotFGysezKDx3mbxL05Kj3cMXDi0vHvab4wsWXDzo/Sw9ehxfYXZCz4L7gZfBJ3g6+BR8H3QC84DGvwZ/BX8HfzTOG+Yxq+N3yz19q3a5tNg42n8R8LJbd7</latexit> <latexit sha1_base64="dhlwdY5Bj2eM54CTl3G/02ATLGI=">AJ03icfVZbjxs1FJ6W2ybctvDIy6gREqaoMq4AWptN0tVckS9hpJ916PCeJtePxYDu3WsMDgkf+Ab+GV/gD/BvOjCdNYieMlOTkfN85c3wutuM8ZUofHPx76/Zb7/z7nt7jeb7H3z40cf7dz65UGIiKZxTkQrZj4mClGVwrplOoZ9LIDxO4TK+eVLil1OQionsTC9yGHAytiQUaJRdb3/Vf/lvfDbMCJyxMn82vSL8NWrSMNcG5jnQDUkYdTKhWKaTUGFLPulCPt3r/dbBw8Oqif0hU4tIL6V3f2fs9SgSdcMg0TYlSV52DXA8MkZrRFIpmNFGQE3pDRnCFYkY4qIGpFliEn6MmCYdC4ifTYaVdtzCEK7XgMTI50WPlYqVyG3Y10cNvBoZl+URDRu2LhpM01CIsxUmTGIO0gUKhErMAQ3pmEiCeZGqufGaRJWxbSzExELcaBIrR8s3/5N0JND32FfnCiaYNZFsJsioSUxJXlZwUz+TJB+yESozmFHBOckSEw3ZvDARxLjQok0R8/7hUNBeYNyfHjpUuIuMmJuh7Qt4DnNJ5bYO4Bry3w2gNiC8QeQC1APWBhgYUHzCw84CpBaYeQNJ8TEpQpEnZTSI1kdW5TMFh5DKtzmXyiUNDhcs5ZTh7Ds3qHGZPijJBPVk0NwF+UlVPjylJzYlrxvtrqFelRJZVr4de0gx7qCqW9vGsV95TourzmDlu9XxnBNdroxT89Qzxq5OLeY5HuFeU8bEWeIgh6twDl0rlunEBnS/4khukmJLUIhZGnbBkliykCZhnTgFuou4TsOdQVheuW8qaqIuYEfxAwkxa15m8nJahleuViGHfrStL24tSZKqFIi9wFy1nDeP1hW9SANyF1V/gdMdW1SaTHoL0ufFHbvXCBZ7az7x869oiOtvmb0qWr1sOWzN6CnhISOhin7MQRIt5D1THVIM+wJ/o/ul9H9EMl8SUdpFvCyMOWXO1CgxwKbp6qtOTw+rYPGhAgJ3NS/hTmrhc2zYK5QAneUiFo6P3utIi2kuIV6fFOEmRqPbQdnipWTDQdtysLZ8QsXtHaIwmQLb7GeGWY/F25WxnSEeTFOcZhni5YHjKh5nI+ELkeGQqIHKXYcbyN4s5ft7btRoFP5ebkzEotFGysezKDx3mbxL05Kj3cMXDi0vHvab4wsWXDzo/Sw9ehxfYXZCz4L7gZfBJ3g6+BR8H3QC84DGvwZ/BX8HfzTOG+Yxq+N3yz19q3a5tNg42n8R8LJbd7</latexit> <latexit sha1_base64="dhlwdY5Bj2eM54CTl3G/02ATLGI=">AJ03icfVZbjxs1FJ6W2ybctvDIy6gREqaoMq4AWptN0tVckS9hpJ916PCeJtePxYDu3WsMDgkf+Ab+GV/gD/BvOjCdNYieMlOTkfN85c3wutuM8ZUofHPx76/Zb7/z7nt7jeb7H3z40cf7dz65UGIiKZxTkQrZj4mClGVwrplOoZ9LIDxO4TK+eVLil1OQionsTC9yGHAytiQUaJRdb3/Vf/lvfDbMCJyxMn82vSL8NWrSMNcG5jnQDUkYdTKhWKaTUGFLPulCPt3r/dbBw8Oqif0hU4tIL6V3f2fs9SgSdcMg0TYlSV52DXA8MkZrRFIpmNFGQE3pDRnCFYkY4qIGpFliEn6MmCYdC4ifTYaVdtzCEK7XgMTI50WPlYqVyG3Y10cNvBoZl+URDRu2LhpM01CIsxUmTGIO0gUKhErMAQ3pmEiCeZGqufGaRJWxbSzExELcaBIrR8s3/5N0JND32FfnCiaYNZFsJsioSUxJXlZwUz+TJB+yESozmFHBOckSEw3ZvDARxLjQok0R8/7hUNBeYNyfHjpUuIuMmJuh7Qt4DnNJ5bYO4Bry3w2gNiC8QeQC1APWBhgYUHzCw84CpBaYeQNJ8TEpQpEnZTSI1kdW5TMFh5DKtzmXyiUNDhcs5ZTh7Ds3qHGZPijJBPVk0NwF+UlVPjylJzYlrxvtrqFelRJZVr4de0gx7qCqW9vGsV95TourzmDlu9XxnBNdroxT89Qzxq5OLeY5HuFeU8bEWeIgh6twDl0rlunEBnS/4khukmJLUIhZGnbBkliykCZhnTgFuou4TsOdQVheuW8qaqIuYEfxAwkxa15m8nJahleuViGHfrStL24tSZKqFIi9wFy1nDeP1hW9SANyF1V/gdMdW1SaTHoL0ufFHbvXCBZ7az7x869oiOtvmb0qWr1sOWzN6CnhISOhin7MQRIt5D1THVIM+wJ/o/ul9H9EMl8SUdpFvCyMOWXO1CgxwKbp6qtOTw+rYPGhAgJ3NS/hTmrhc2zYK5QAneUiFo6P3utIi2kuIV6fFOEmRqPbQdnipWTDQdtysLZ8QsXtHaIwmQLb7GeGWY/F25WxnSEeTFOcZhni5YHjKh5nI+ELkeGQqIHKXYcbyN4s5ft7btRoFP5ebkzEotFGysezKDx3mbxL05Kj3cMXDi0vHvab4wsWXDzo/Sw9ehxfYXZCz4L7gZfBJ3g6+BR8H3QC84DGvwZ/BX8HfzTOG+Yxq+N3yz19q3a5tNg42n8R8LJbd7</latexit> The most straightforward policy one might think of is greedy: —always choose the points with highest probabilities X ∗ = arg max “expected #positives in X ” X 4

Recommend


More recommend