Question Solved

What metrics should I use to evaluate a text summarization model? (61)

Back to Forum
Growing 180 pts 0 followers
Bearys Institute of Technology · Posted
Entrepreneurship & Innovation Public Health & Epidemiology

My question

I have been collecting data for my thesis research and realized I may have an ethical issue. I surveyed 450 college students about their academic stress and mental health. The survey was anonymous, but I am now questioning whether I need IRB approval retroactively.

The situation:

  • The survey was done purely as pilot research before my formal thesis proposal
  • I used Google Forms and data was stored on my university Google Drive
  • No personally identifying information was collected
  • This is at an Indian university (not a US institution)

What are the ethics review requirements for student survey research in Indian universities? Is anonymous pilot data typically exempt?

Sign in to interact

Sign in to join the discussion.

9 Replies

Oldest Top
0
Tara Singh Starting 5 pts · Accepted answer

I found that writing a paper abstract first (before the paper) and then reverse-engineering the paper from the abstract helped with clarity enormously.

0
Replying to Tara Singh
Revathi Chandrasekaran Active 410 pts · Accepted answer

This is exactly what I needed. Thank you so much.I have been going back and forth on this for weeks and this clears it up completely.

0
Replying to Tara Singh
Eshan Patil Growing 70 pts · Accepted answer

Thank you for the honest take. This is the kind of answer I was looking for.not the sanitized version.

0
Replying to Tara Singh
Lakshmi Devi Growing 75 pts · Accepted answer

The IEEE TPAMI turnaround in my case was 7 months for the first review. Plan accordingly.

0
Pooja Nambiar Growing 115 pts · Accepted answer

Great question.I went through something very similar in my second year.

The key insight for me was that LoRA is actually quite well-suited for NER tasks, especially in low-resource settings. I would recommend:

  1. Use LoRA with r=8 or r=16.don't go higher for 8K samples
  2. Apply LoRA to attention layers only, not the feed-forward layers
  3. Use a cosine learning rate schedule with warm-up (10% of steps)

For Telugu-English code-mixed NER specifically, you might also look at MuRIL.it is pretrained on Indian language data and often outperforms XLM-R on Indic tasks even with less fine-tuning data.

0
Sowmya Narayanan Active 310 pts · Accepted answer

I think you are conflating two separate problems here. The publish-or-perish culture creates pressure, yes.but the solution is not to criticize researchers who are navigating an unfair system. The real problem is with evaluation committees who treat publication count as a proxy for research quality. Fix the evaluation, and the incentives change.

Also worth noting: open review has been implemented in some fields and has its own problems. It can disadvantage early-career researchers who fear retaliation from senior colleagues they have reviewed critically.

0
Replying to Sowmya Narayanan
Rajesh Kumar · Accepted answer

I am in a very similar situation. Would you be willing to share the outline of your PMRF proposal? Not the content.just the section headings and approximate word allocation.

0
Replying to Sowmya Narayanan
Shiva Prasad Active 480 pts · Accepted answer

Thank you for the honest take. This is the kind of answer I was looking for.not the sanitized version.

0
Replying to Sowmya Narayanan
Harini Balakrishnan Active 215 pts · Accepted answer

This question comes up a lot. The answer really depends on your specific field and what your committee values.