Videos are probably not the best way to promote your album by itself, but do make sense in a well rounded campaign. Before you run off making a video, decide what that video's purpose is and how you're going to get large numbers of people to see it.

It's a lot of work to generate qualified traffic on the internet unless you're willing to pay. TV and Radio aren't free either. If you had a video, how would you get people to watch it?