Is it illegal to abuse nitrous oxide?

Me and my pals often like taking some laughing gas. By saying often, I mean like once a week. Is it illegal? Can N2O cause any serious health problems if used often? Thank you.