Aquaponics is a technology for food production (fish and vegetables/fruits) with concomitant remediation of nitrogen-rich aquaculture effluent. There is, however, a critical need to improve the nitrogen use efficiency (NUE) in aquaponics. Here, we employed quantitative polymerase chain reactions and next-generation sequencing to evaluate the bacterial communities and their links to nitrogen transformations for improving NUEs in four bench-scale plant-based floating-raft aquaponics (pak choi, lettuce, chive, and tomato) and three pH levels (7.0, 6.0, and 5.2). Low relative abundance of nitrifiers in plant roots and biofilters suggested nitrogen loss, which decreased NUE in aquaponics. Low pH level was a major factor that shifted the microbial communities and reduced the relative abundance of nitrifiers in aquaponic systems, leading to total ammonia nitrogen accumulation in recirculating water. In plant roots, the abundance of nitrite-oxidizing bacteria (e.g., Nitrospira spp.) did not decrease at low pH levels, suggesting the benefit of growing plants in aquaponics for efficient nitrification and improving NUE. These findings on microbial communities and nitrogen transformations provided complementary strategies to improve the performance of the aquaponics regarding water quality and extent of nutrient recovery from aquaculture effluent.