As Jeff mentioned, you can both go together through the citizen/resident line. The first time we went after being married we went through the non-resident line together and the officer told us we coulda used the other line, so we’ve done that since and it hasn’t been a problem.
Since you have a child now, you would probably be better off filing as head of household, but you can only do that if your spouse doesn’t have a green card. See here: [Forumosa - Taiwan's largest and most active Taiwan-oriented global online community in English … 892#114892](Does Taiwanese spouse need to file US tax return? - #10 by jlick