Your Docker client does not know your Docker host (as thoroughly explained here).
You need to tell the Docker client where the Docker host is, and you can do that by using the -H option:
$ docker -H localhost:2375 some docker command
If you don't want to type the host every time, you can set up and environment variable called DOCKER_HOST to localhost:2375
$ export DOCKER_HOST=localhost:2375
But, that environment variable will last only as long as the session does. You would have to set it every time you open bash. So, in order to avoid that, you set that variable in a file called .bash_profile in your home directory, like this:
$ echo “export DOCKER_HOST=localhost:2375” >> ~/.bash_profile
Also make sure you expose the daemon on Windows which you can achieve in the Settings menu (tab “General”) of Docker for Windows.
Restart the bash console and the DOCKER_HOST variable should be there, just type e. g. docker images to check everything is there.