St Cuthbert's Day Centre, which provides daytime care for pensioners, is expected to close by the end of August.
The centre, which is owned and managed by the Roman Catholic Diocese of Hexham and Newcastle, is based behind St Cuthbert's RC Church, in Stockton Road, Hartlepool.
The diocese have taken the decision to close the centre because they claim not enough people are using the service.
Maureen Fountain's mother, Tess Fountain, 86, attends the day centre twice a week and she is angry that it is set to close leaving pensioners with nowhere to go.
Mrs Fountain, 61, of Ventnor Avenue, said: "The care centre is supposed to be about social inclusion and social interaction but if they close it then many people would be lost. My mother has problems with her memory and she is comfortable in the surroundings there.
"They say numbers are down but that is because social services have stopped bringing people here. They were going to close it a year ago but we had a petition and it stayed open.
"They used to have about 100 people a week going but that is down to 15 a day.
"The main thing is that the pensioners have other people to talk to when they are in there."
The centre offers a three course meal to pensioners and they can also play bingo, cards, dominoes, do arts and crafts, hairdressing and go out on day trips.
Nobody was available for comment when contact by the Mail, but a letter from the diocese to users read: "In order to provide more modern services at St Cuthbert's Day Centre additional expenditure is required which is not financially viable given the limited number of attendees.
"We are working closely with Hartlepool Borough Council to try and relocate aspects of the service to the new Hartfields development at Middle Warren."
The potential relocation is only one option and the diocese say alternatives will be discussed on an individual basis.
Representatives from the council and diocese are expected to meet with staff next week to discuss their futures.
The council's adult and community services department has a contract to provide day services to the centre but does not run the service.
A council spokesman said: "The closure decision has been taken by the diocese, and it reflects changes to the way that care services are now offered to people.
"The introduction of initiatives such as direct payments and individual budgets has led to a significant reduction in the numbers attending the day centre because more people are exercising their right to choose services provided in the community instead of traditional, building-based day care services.
"The council is committed to working closely with the diocese to ensure that the assessed needs of every individual are met during this time."