Depending upon which group you may be in, or who composes your circle of friends, might make the difference in what one means by the word, or how one takes being called that.
Most of the people around here would take hacker like you said, as one that is destructive. It may not be fair to all that it have a negative connotation, but it seems that it does.
Dave
