Skip to main content
updated link
Source Link
richliaw
  • 2.1k
  • 17
  • 17

Another viable (and documented) option for grid search with Tensorflow is Ray TuneRay Tune. It's a scalable framework for hyperparameter tuning, specifically for deep learning/reinforcement learning.

You can try out a fast tutorial here.

It also takes care of Tensorboard logging and efficient search algorithms (ie, HyperOpt integration and HyperBand) in about 10 lines of Python.

import ray from ray import tune def train_tf_model(config, tune_reporter): # 1 new arg for reporting results   # ...for traini herein ....range(num_epochs):   # ... train here ....  accuracy = #train_one_epoch(model)  ... train here ....  pass raytune.initreport(acc=accuracy) tune.run(train_tf_model, stop={ "mean_accuracy": 100 }, config={ "alpha": tune.grid_search([0.2, 0.4, 0.6]), "beta": tune.grid_search([1, 2]), }) 

(Disclaimer: I contribute actively to this project!)

Another viable (and documented) option for grid search with Tensorflow is Ray Tune. It's a scalable framework for hyperparameter tuning, specifically for deep learning/reinforcement learning.

You can try out a fast tutorial here.

It also takes care of Tensorboard logging and efficient search algorithms (ie, HyperOpt integration and HyperBand) in about 10 lines of Python.

import ray from ray import tune def train_tf_model(config, tune_reporter): # 1 new arg for reporting results   # ... train here ....   # ... train here ....  # ... train here ....  pass ray.init() tune.run(train_tf_model, stop={ "mean_accuracy": 100 }, config={ "alpha": tune.grid_search([0.2, 0.4, 0.6]), "beta": tune.grid_search([1, 2]), }) 

(Disclaimer: I contribute actively to this project!)

Another viable (and documented) option for grid search with Tensorflow is Ray Tune. It's a scalable framework for hyperparameter tuning, specifically for deep learning/reinforcement learning.

You can try out a fast tutorial here.

It also takes care of Tensorboard logging and efficient search algorithms (ie, HyperOpt integration and HyperBand) in about 10 lines of Python.

from ray import tune def train_tf_model(config): for i in range(num_epochs): accuracy = train_one_epoch(model)  tune.report(acc=accuracy) tune.run(train_tf_model, config={ "alpha": tune.grid_search([0.2, 0.4, 0.6]), "beta": tune.grid_search([1, 2]), }) 

(Disclaimer: I contribute actively to this project!)

edit link
Source Link
richliaw
  • 2.1k
  • 17
  • 17

Another viable (and documented) option for grid search with Tensorflow is Ray Tune. It's a scalable framework for hyperparameter tuning, specifically for deep learning/reinforcement learning.

You can try out a fast tutorial herea fast tutorial here.

It also takes care of Tensorboard logging and efficient search algorithms (ie, HyperOpt integration and HyperBand) in about 10 lines of Python.

import ray from ray import tune def train_tf_model(config, tune_reporter): # 1 new arg for reporting results # ... train here .... # ... train here .... # ... train here .... pass ray.init() tune.run(train_tf_model, stop={ "mean_accuracy": 100 }, config={ "alpha": tune.grid_search([0.2, 0.4, 0.6]), "beta": tune.grid_search([1, 2]), }) 

(Disclaimer: I contribute actively to this project!)

Another viable (and documented) option for grid search with Tensorflow is Ray Tune. It's a scalable framework for hyperparameter tuning, specifically for deep learning/reinforcement learning.

You can try out a fast tutorial here.

It also takes care of Tensorboard logging and efficient search algorithms (ie, HyperOpt integration and HyperBand) in about 10 lines of Python.

import ray from ray import tune def train_tf_model(config, tune_reporter): # 1 new arg for reporting results # ... train here .... # ... train here .... # ... train here .... pass ray.init() tune.run(train_tf_model, stop={ "mean_accuracy": 100 }, config={ "alpha": tune.grid_search([0.2, 0.4, 0.6]), "beta": tune.grid_search([1, 2]), }) 

(Disclaimer: I contribute actively to this project!)

Another viable (and documented) option for grid search with Tensorflow is Ray Tune. It's a scalable framework for hyperparameter tuning, specifically for deep learning/reinforcement learning.

You can try out a fast tutorial here.

It also takes care of Tensorboard logging and efficient search algorithms (ie, HyperOpt integration and HyperBand) in about 10 lines of Python.

import ray from ray import tune def train_tf_model(config, tune_reporter): # 1 new arg for reporting results # ... train here .... # ... train here .... # ... train here .... pass ray.init() tune.run(train_tf_model, stop={ "mean_accuracy": 100 }, config={ "alpha": tune.grid_search([0.2, 0.4, 0.6]), "beta": tune.grid_search([1, 2]), }) 

(Disclaimer: I contribute actively to this project!)

update link
Source Link
richliaw
  • 2.1k
  • 17
  • 17

Another viable (and documented) option for grid search with Tensorflow is Ray Tune. It's a scalable framework for hyperparameter tuning, specifically for deep learning/reinforcement learning.

You can try out a fast tutorial herea fast tutorial here.

It also takes care of Tensorboard logging and efficient search algorithms (ie, HyperOpt integration and HyperBand) in about 10 lines of Python.

import ray from ray import tune def train_tf_model(config, tune_reporter): # 1 new arg for reporting results # ... train here .... # ... train here .... # ... train here .... pass ray.init() tune.run_experimentsrun({ "my_experiment": { "run": train_tf_model, "stop": stop={ "mean_accuracy": 100 }, "config": config={ "alpha": tune.grid_search([0.2, 0.4, 0.6]), "beta": tune.grid_search([1, 2]), }} }) 

(Disclaimer: I contribute actively to this project!)

Another viable (and documented) option for grid search with Tensorflow is Ray Tune. It's a scalable framework for hyperparameter tuning, specifically for deep learning/reinforcement learning.

You can try out a fast tutorial here.

It also takes care of Tensorboard logging and efficient search algorithms (ie, HyperOpt integration and HyperBand) in about 10 lines of Python.

import ray from ray import tune def train_tf_model(config, tune_reporter): # 1 new arg for reporting results # ... train here .... # ... train here .... # ... train here .... pass ray.init() tune.run_experiments({ "my_experiment": { "run": train_tf_model, "stop": { "mean_accuracy": 100 }, "config": { "alpha": tune.grid_search([0.2, 0.4, 0.6]), "beta": tune.grid_search([1, 2]), }}}) 

(Disclaimer: I contribute actively to this project!)

Another viable (and documented) option for grid search with Tensorflow is Ray Tune. It's a scalable framework for hyperparameter tuning, specifically for deep learning/reinforcement learning.

You can try out a fast tutorial here.

It also takes care of Tensorboard logging and efficient search algorithms (ie, HyperOpt integration and HyperBand) in about 10 lines of Python.

import ray from ray import tune def train_tf_model(config, tune_reporter): # 1 new arg for reporting results # ... train here .... # ... train here .... # ... train here .... pass ray.init() tune.run(train_tf_model, stop={ "mean_accuracy": 100 }, config={ "alpha": tune.grid_search([0.2, 0.4, 0.6]), "beta": tune.grid_search([1, 2]),  }) 

(Disclaimer: I contribute actively to this project!)

update API
Source Link
richliaw
  • 2.1k
  • 17
  • 17
Loading
Source Link
richliaw
  • 2.1k
  • 17
  • 17
Loading