With the introduction of the Pradhan Mantri-Kisan Samman Nidhi scheme by the union government, and more comprehensive schemes such as Krushak Assistance for Livelihood and Income Augmentation of the Government of Odisha, there is an emergence of various direct benefit transfer schemes for agricultural households. Political expediency aside, these schemes offer an opportunity to think about challenges and opportunities in evaluating causal impacts of large-scale public programmes. Using the case of the KALIA scheme in Odisha, the challenges arising out of multiple objectives, unintended consequences, and lack of appropriate counterfactuals in evaluating DBTs are demonstrated. The insights are applicable to DBT programmes in general.