As Paco said, your sentence, after the comma, is an absolute participle construction. It is also grammatically correct; however, you shall want to drop the pronoun before the construction. There is no ambiguity in your saying "The castle stood before me, walls cracked and crumbling."