I heard that she is supposed to come back in the next episode, "Remote Control", although I am not sure if this is accurate

Yeah, she is. She's having her baby. So she'll be back after her maternity leave.