Black box around image and blurry text on HDMI - Fix

I am not sure why, but there is a default setting when I connect my PC to and HDMI TV or monitor. I would get something like this :

It was somewhat frustrating not knowing why my new screen doesn't look as amazing as I would like it to. Actually, I just wanted text to look crisp on a big screen.

Going into the settings panel, I found this :
AMD Catalyst Control Center -> My Digital Flat-Panels-> Scaling Options:

The correction is setting the underscan to 0%. Move the slider all the way to the right to the 0%.

( I don't know why it is labeled "Overscan". )