I am actually quite surprised that this solution has not been presented yet, and I feel like it is the easiest solution.
Go to GitHub, find the version of the brewfile that matches the version of icu4c that you need and get the raw version of the file (follow the links above and click View File then Raw).
Then just have brew reinstall from that url.
For example, version 62.1:
brew reinstall https://raw.githubusercontent.com/Homebrew/homebrew-core/575eb4bbef683551e19f329f60456b13a558132f/Formula/icu4c.rb
For example, version 64.2:
brew reinstall https://raw.githubusercontent.com/Homebrew/homebrew-core/a806a621ed3722fb580a58000fb274a2f2d86a6d/Formula/icu4c.rb
UPDATE:
Later versions of Homebrew may require you to download the file first. If this is the case:
wget https://raw.githubusercontent.com/Homebrew/homebrew-core/a806a621ed3722fb580a58000fb274a2f2d86a6d/Formula/icu4c.rb brew reinstall icu4c.rb
/usr/local/opt/icu4cdidn't exist, andbrew reinstall icu4cgave me a bunch of "permission denied" issues for the icu4c dir. So Isudo rm -rf /usr/local/Cellar/icu4candbrew reinstall icu4c, and everything worked.brew upgradehelped me