Can I legally lose my job for this?

If they hired you with that same record, then no. You did nothing wrong here. Have the lady speak for you, if something goes bad.