Data Analyst Jobs at Web Spiders – Kolkata

Company: Web Spiders
Job Title: Data Analyst – Consumer Spend Research
Location: Rajarhat, New Town, Kolkata, West Bengal, India
Work Mode: On-site
Employment Type: Full-time
Experience Required: 1–3 years
Industry: Data Analytics, Consumer Research, and Technology

About Web Spiders

Web Spiders is a technology company offering digital and technology solutions. For this role, the team focuses on consumer spend research and data engineering, transforming US consumer credit card transaction data into accurate, reliable datasets and actionable business insights.

Job Overview

Web Spiders is hiring a Data Analyst for Consumer Spend Research at its Kolkata office. This role combines analytical research with hands-on data engineering and pipeline development.

The selected candidate will analyse US consumer credit card transaction data, research and classify brands and merchants, investigate data discrepancies, and produce analytical reports. The role also involves building and maintaining ETL/ELT pipelines using Python and SQL, working with AWS data services, and supporting automated data workflows.

Candidates should have strong Python and SQL skills, mandatory knowledge of regular expressions, familiarity with cloud data infrastructure, and the ability to conduct detailed online research. The role offers opportunities to work with senior data engineers, data scientists, and analysts.

Key Responsibilities

Consumer Spend Research and Analysis

• Analyse US consumer credit card transaction data to identify patterns, anomalies, and variations.
• Research brands and merchants online and accurately map transaction records to the correct entities.
• Use search engines, directories, and alternative online sources to resolve ambiguous or incomplete data.
• Prepare clear analytical reports and insight summaries for client-side stakeholders.
• Conduct exploratory data analysis to investigate discrepancies, identify trends, and support product and business decisions.

Data Engineering and Pipeline Development

• Build and maintain ETL/ELT scripts and data transformation logic using Python and SQL.
• Develop clean, tested, and documented Python scripts for data ingestion, cleaning, validation, and enrichment.
• Support data workflows orchestrated with Apache Airflow, including monitoring and troubleshooting failed runs.
• Work with AWS services such as Amazon S3, AWS Glue, Amazon Athena, and Amazon Redshift.
• Write and optimise complex SQL queries to process and analyse large transaction datasets.
• Use regular expressions to filter, classify, and clean data.
• Implement data quality checks, reconciliation routines, and alerting to identify issues before they affect downstream processes.

Development Practices and Documentation

• Use AI-assisted coding tools and IDE integrations, such as Kiro, for development, testing, debugging, and documentation.
• Follow Git-based version control and code review practices.
• Apply data governance, security, and access-control standards.
• Document data pipelines, definitions, classification rules, and analytical methods.

Required Qualifications

• Graduate in any discipline. Degrees in Computer Science, Engineering, Statistics, Data Science, Mathematics, or related fields are preferred.
• 1–3 years of professional experience in data analysis, data engineering, market research, or a related role.
• Strong Python skills, including experience with pandas and production-quality scripting.
• Strong SQL knowledge, including joins, window functions, aggregations, and query optimisation.
• Working knowledge of regular expressions for pattern matching and data classification. This is mandatory.
• Working exposure to AWS services, including S3, Glue, Athena, and Redshift.
• Understanding of ETL/ELT concepts, data modelling, and relational database design.
• Familiarity with Git and collaborative software development workflows.
• Experience using AI-assisted development tools for prototyping, code generation, testing, and debugging.
• Proficiency with Microsoft Office, particularly Excel, Word, and Outlook.
• Good written and spoken English, with the ability to communicate confidently with client-side stakeholders.

Essential Professional Skills

• Strong analytical and critical-thinking abilities.
• Attention to detail when reviewing complex transaction records and alphanumeric strings.
• Excellent online research skills and the ability to identify reliable sources of information.
• Ability to learn unfamiliar software and navigate new interfaces quickly.
• Clear written communication and the ability to explain analytical decisions.
• Openness to feedback, collaboration, and continuous learning.

Good-to-Have Skills

• Hands-on experience with Apache Airflow or a similar workflow orchestration tool.
• Experience with data annotation, taxonomy development, or data markup.
• Exposure to machine learning, large language model (LLM) workflows, or feature preparation for data science projects.
• Previous experience working with US market data or financial transaction datasets.
• Residence within approximately one hour of the office.

Work Schedule and Location

The role is based at the company’s office in Rajarhat, New Town, Kolkata.

Candidates must be able to work in the US Eastern Time Zone. Depending on project requirements, the schedule may be adjusted to a combination of half a day in Indian Standard Time (IST) and half a day in US Eastern Standard Time (EST).

Job Details

Category	Details
Company	Web Spiders
Position	Data Analyst – Consumer Spend Research
Location	Rajarhat, New Town, Kolkata
Work Mode	On-site
Employment Type	Full-time
Experience	1–3 years
Key Technologies	Python, pandas, SQL, AWS, Git
Mandatory Skill	Regular expressions
Preferred Tools	Apache Airflow, AI-assisted coding tools
Salary	Not specified
Education	Graduate in any discipline
Work Schedule	US Eastern Time Zone flexibility required

Who Should Apply?

This opportunity is suitable for early-career professionals with 1–3 years of experience who enjoy solving data-quality problems, conducting detailed online research, and building data pipelines. Candidates with a combination of Python, SQL, regex, and cloud data experience may be particularly well suited to the role.

How to Apply

Interested candidates can review the full job details and submit their application through the official Web Spiders careers page.

Apply here: Web Spiders – Data Analyst