The short answer is yes.
Some reasons why:
- Ability to log bugs that have been found against specific versions.
- Ability to know which (known) bugs haven't been fixed yet.
- Track who fixed a bug that has since been found again.
- Developer turnover - allows for knowledge transfer even if you get hit be the proverbial bus.
You will probably want to look at something that won't take much time for you to setup/manage. I would also suggest looking for something that includes that ability to integrate it with your source control.