Small farmers are one of the more disadvantaged and vulnerable groups in Nigeria. Studies have shown that majority of people living in absolute poverty can be found on small farms. Research question this study pose was: are these small farms going to be a declining farms or vice-versa? Hence, the study looks into heterogeneity in circumstances and diversity in rural livelihoods. Data come from Nigerian living Standard Survey (NLSS) collected in two periods (2004 and 2014) and analyzed with a probability sample of 9550 respondents’ from six zones in Nigeria and 8264 sample size that were useful for subsequent analysis. The study kept track of the same sampled households. Findings revealed that the index of heterogeneity to be at differentials of 29.1 which indicated growth of small farms in the two periods under consideration. Poverty decomposition analysis revealed that about 42% (3448) of the respondents were categorized as very poor, 21% (1768) as poor and only 37% (3048) were categorized as non-poor with about 17.25%, 14.71% and 12.19% variations respectively in the two periods. The poverty differential analysis in the two surveys revealed that those farming households who operated small farms experienced higher poverty levels by 14.72%. This thus implies that the tenacity of small farms was correlated to poverty increase.