Help! Sewage in backyard.?

Well, for starters we don't have a septic tank. But there is a pipe coming up from the ground in my backyard and sewage has been coming up through it. When we bought the house 2 years ago we had all the pipes replaced and they checked whatever that is in the back and said it looked good. What the heck is that thing and who do I call to fix it?