Data Science Insider: January 15th , 2024

We apologize for the delay in sending you this edition of the Data Science Insider. The next edition will be sent as usual. In This Week’s SuperDataScience Newsletter: OpenAI Launches GPT Store: Custom Chatbots Marketplace. Open Alternatives to Databricks SQL. Data Scientists Navigate Changing Interdisciplinary Dynamics. Oxford's ML Breakthrough Narrows 'Reality Gap.' CES 2024 Unveils AI Marvels. Cheers, - The SuperDataScience Team P.S. Have friends and colleagues who could benefit from these weekly updates? Send them to [this link]( to subscribe to the Data Science Insider. --------------------------------------------------------------- [OpenAI Launches GPT Store: Custom Chatbots Marketplace]( brief: OpenAI has officially launched the GPT Store, allowing users to share their custom chatbots created through the GPT Builder program. Despite delays, the store broadens ChatGPT's potential applications and expands OpenAI's ecosystem beyond its own developments. The platform enables subscribers to OpenAI's paid tiers to publicly share their custom GPTs, with plans to introduce a revenue-sharing program for GPT creators based on user engagement. The GPT Store's rollout includes ChatGPT Plus, Enterprise users, and a new tier named ChatGPT Team, catering to smaller teams with features like access to GPT-4 and DALL-E 3. This expansion of ChatGPT's capabilities offers data scientists opportunities to showcase their work, potentially leading to a revenue-sharing model based on user engagement. Why this is important: The rollout of the ChatGPT Team tier provides a tailored solution for smaller teams, enabling them to leverage advanced features and create custom GPTs for specific needs. [Click here to learn more!]( [Open Alternatives to Databricks SQL]( brief: In the realm of data science, Databricks SQL Warehouse, a component of the Databricks platform, offers scalable SQL compute resources detached from storage for seamless data analysis. While advantageous for data analysts, its drawbacks include cost concerns, limited customization, vendor lock-in, and constraints in ML and real-time processing. Recognizing these challenges, experts in the field explore open-source alternatives in this Medium article. StarRocks, a distributed OLAP database, excels in real-time analytics, supporting major open table formats. ClickHouse, a column-oriented DBMS, prioritizes speed and scalability. Trino, a distributed SQL query engine, facilitates large dataset handling across diverse sources. Understanding these alternatives is crucial for data scientists seeking cost-effective and customizable solutions with enhanced functionality. Why this is important: After weighing these considerations, you can begin refining your options and selecting the open-source alternative to Databricks SQL Warehouse that best suits your needs. [Click here to read on!]( [Data Scientists Navigate Changing Interdisciplinary Dynamics]( brief: In the article "Examining the Influence Between NLP and Other Fields of Study" by Jan Philip Wahle, in Towards Data Science the author comprehensively explores the evolving relationship between Natural Language Processing (NLP) and other academic disciplines. Drawing on data and visualizations, the study analyzes citations between NLP and 23 distinct fields. Findings reveal a significant increase in NLP's reliance on Computer Science, reaching 83% by 2020. While linguistics, mathematics, psychology, and sociology remain influential, there's been a notable decline in NLP's engagement with diverse fields over time. The article highlights the diminishing interdisciplinarity of NLP papers, emphasizing the importance of broadening engagement beyond CS for responsible research and development. Why this is important: The study underscores the need for data scientists to actively choose diverse literature engagement, fostering cross-field exchanges. The declining interdisciplinarity of NLP papers raises concerns about potential blind spots and highlights the importance of incorporating ideas from linguistics, psychology, and social sciences for more comprehensive and responsible advancements in NLP technologies. [Click here to discover more!]( [Oxford's ML Breakthrough Narrows 'Reality Gap']( In brief: A University of Oxford-led study is employing ML to address a critical challenge in quantum devices, bridging the 'reality gap' between predicted and observed quantum behaviour. Published in Physical Review X, the research utilises a "physics-informed" ML approach to indirectly infer nanoscale disorder characteristics affecting quantum devices. Lead researcher Associate Professor Natalia Ares compares the process to improving predictions in crazy golf, narrowing the gap between expected and actual outcomes. The model not only identifies internal disorder profiles but also quantifies variability between quantum devices, offering a potential breakthrough for accurate predictions and engineering optimal materials. The study provides a groundbreaking approach to address the inherent variability in quantum behaviour, crucial for the scalability and integration of individual quantum devices. Why this is important: By leveraging ML to indirectly infer nanoscale disorder characteristics, the research contributes to more accurate predictions of quantum device performance. This not only aids in mitigating material imperfections but also opens avenues for engineering quantum materials optimally. [Click here to see the full picture!]( [CES 2024 Unveils AI Marvels]( In brief: CES 2024, a premier tech event, is taking place - showcasing groundbreaking gadgets and innovations. LG introduces a game-changing 77-inch transparent TV, the OLED T, resembling a glass pane when not in use, providing a versatile viewing experience. LG also unveils a smart home AI companion capable of tasks like pet monitoring and environmental sensing. Samsung presents an AI-powered fridge recognizing 33 foods, suggesting recipes based on contents, and even ordering missing ingredients. Nvidia collaborates with Convai to bring AI-controlled non-playable characters to video games, offering spontaneous and emotionally aware interactions with players. Data scientists should track CES 2024 developments as emerging technologies like AI-powered fridges and transparent TVs present new data streams and challenges as well as entertainment! Why this is important: Understanding these innovations can inspire data scientists to explore applications in user behaviour analysis, predictive maintenance for smart devices, and enhanced human-computer interactions. The integration of AI in gaming NPCs signifies advancements in natural language processing and emotional awareness, impacting data-driven approaches to game development and user experience analysis. [Click here to see the full picture!]( [Super Data Science podcast]( In this week's [Super Data Science Podcast]( episode, Kirill Eremenko joins host Jon Krohn to dive deep into Large Language Models (LLMs). Explore what goes into well-crafted LLMs, different architectures like GPT & BERT, what makes Transformers so powerful, and how to succeed as a data scientist in this new age of generative AI. [Click here to find out more!]( --------------------------------------------------------------- What is the Data Science Insider? This email is a briefing of the week's most disruptive, interesting, and useful resources curated by the SuperDataScience team for Data Scientists who want to take their careers to the next level. Want to take your data science skills to the next level? Check out the [SuperDataScience platform]( and sign up for membership today! Know someone who would benefit from getting The Data Science Insider? Send them [this link to sign up.]( # # If you wish to stop receiving our emails or change your subscription options, please [Manage Your Subscription]( SuperDataScience Pty Ltd (ABN 91 617 928 131), 15 Macleay Crescent, Pacific Paradise, QLD 4564, Australia