Structured, semi-structured, and unstructured data are the three categories of data sources that can be classified. Unstructured data account for approximately 80% of all global data, whereas structured data account for only 20%.
As models have become more sophisticated and pushbutton, AI teams have realized that focusing on data iteration is just as important, if not more so, for developing and deploying high-accuracy models successfully and efficiently. ML models have become increasingly complicated and opaque in recent years, necessitating significantly larger amounts of training data. In addition, data have evolved into a useful interface for working with subject matter experts and transforming their expertise into software. Finally, data-centric AI enables a higher level of model accuracy than was previously feasible using only model centric techniques.
Datasets are dynamic. New files and new versions of existing files enter the datasets at the ingestion stage. Additionally, extractors can evolve over time and generate new versions of raw data. As a result, datasets versioning is a cross-cutting concern across all stages of a datasets. Of course vanilla distributed file systems are not adequate for versioning-related operations. For example, simply storing all versions may be too costly for large datasets, and without a good version manager, just using filenames to track versions can be error-prone. In a datasets, for which there are usually many users, it is even more important to clearly maintain correct versions being used and evolving across different users. Furthermore, as the number of versions increases, efficiently and cost-effectively providing storage and retrieval of versions is going to be an important feature of a successful datasets system.
JZFS was born for the above problems:
A Git-like version control file system for data lineage & data collaboration.
https://github.com/GitDataAI/jzfs
6 months ago
1
Apply to attend LabWeek Field Building at Edge Esmeralda, a pop-up event city in Healdsburg, CA, from June 10-16. The decentralized conference is co-curated with Foresight Institute and will encourage conversations and collaboration to drive progress on four main tracks:
Subscribe to the LabWeek Field Building newsletter for updates: https://labweekfieldbuilding.substack.com/
6 months ago
0
Office Hours are 15-30 minute meetings that members can schedule with others in the Protocol Labs network.
Use this time to discuss some of the most pressing issues your organization is facing. Some common topics include:
When used effectively, Office Hours can be an extremely efficient way to get timely advice, expand your network, and uplevel by learning from leaders in the network.
Learn more:
Please continue to learn how to make Office Hours super effective, and share your learnings in the comments below.
9 months ago
0
Building a company can be a simultaneously emotional, difficult and rewarding journey fraught with challenges. Product dev, legal issues, growth hacking and even the most minute administrative tasks at the early stages of company formation and expansion can be fraught with roadblocks. But how can you tell if the challenges you're facing are normal or a sign that you should pivot?
After tracking pivots in web3, we’ve found that there are four recurring indicators that suggest a pivot may be in order, with some signals evident even before a company raises venture capital.
Indicator 1: The Passion is Gone
Imagine a founder has just won a hackathon, they’re getting flooded with both investor and user interest. The accolades feel amazing and they’re on a high. They decide to raise a round based on this idea. However, before embarking on this journey they should ask themself, are they really passionate about this product? Is it something that they can truly see themself committing the same level of enthusiasm to over the next 10 years?
One of the more surprising reasons that early-stage companies fail is a lack of passion. It’s difficult for anyone to sustain enthusiasm for the length of time that it takes to build and scale a company through its many challenges. However, passion is one of the most important ingredients in a startup’s success. Throughout the company lifecycle, founders have to be the number one hype person for their company. Their passion is:
A lack of passion for product makes every day an uphill battle, even more so if founders are also operating in a space that they’re not as familiar with and need to combat their own disinterest as they learn the ropes. If through introspection founders realize that they’re no longer passionate about what they’re building, they should pivot.
Indicator 2: Being Too Niche
Beware the niche trap which can be particularly prevalent in the crypto and blockchain space given how early the market itself is. Let’s say a founder is extremely passionate about the idea they’re going after, but they keep running into the same roadblock in conversations with investors who are concerned about the market. This signal isn’t always cut and dry, as it could simply stem from investor ignorance. However, founders should be able to clarify this easily for investors, using their own research to illustrate that the market is indeed valuable.
While it’s said that there’s riches in niches, a market that is too small quickly becomes a cage. Founders can avoid falling into this trap by sizing the market themselves before engaging with investors. They should build a TAM and a SOM and validate demand for the product via user interviews/surveys. If their TAM is in the low millions or users don’t show interest in the product, this is a sign that they’re potentially building a solution in search of a problem, and this search will likely be in vain. Trying to service a market that is too small or compressing will limit the company’s ability to reach significant scale as demand will naturally have a low ceiling.This is a sign to consider pivoting.
Indicator 3: Consistent User Acquisition Woes
Some founders reach the point where they have a functioning product that they’ve maintained consistent enthusiasm for and their market is large and attractive, but they’re having trouble on the user acquisition front. This could present itself in a myriad of ways:
Ultimately these scenarios are all signs that user demand isn’t there for the product and indicators that you should consider a pivot.
Indicator 4: Extreme Disruption
Finally we’ve seen companies pivot because of extreme disruption in their space. For example, many realized that OpenAI’s product releases would devour their entire market. Some who were well-capitalized and earlier in development saw the writing on the wall and decided to pivot immediately.
This can be the most difficult indicator to recognize, because most startups claim to be in the business of disruption themselves. However, while it’s one thing to try to disrupt a stagnant legacy business, it’s another to take on a new incumbent that is much better capitalized and further ahead both on R&D and company building. In the worst case scenario, founders risk taking on an established and highly innovative market incumbent whose greater capitalization and brand name awareness threatens any chance they have to carve out even a tiny piece of the market.
It’s important for founders to keep their finger on the pulse of the market. If they’re able to recognize events or trends that could affect their product early-on, this can allow them to be offensive instead of just defensive.
To sum up
It can be difficult to recognize the signs that a pivot is necessary in the day-to-day tumult of fighting fires at a startup. However, it’s important to regularly evaluate whether or not all the necessary elements for startup success are still in place. Founders should ask themselves the following:
If founders struggle to answer any of these questions in the affirmative, it’s an indication that they should potentially consider a pivot.
One More Thing
Founders of great companies have unique non-obvious insights into their markets which others may not recognize, so it’s still important for founders to pay attention to their own intuition. For instance, if founders are positive on all of these signals that doesn’t mean that they must commit to persevering either. There are a myriad of other factors that could cause founders to leave a company, including health issues, family life, legal challenges, etc. And in all cases when pivoting, if founders are unable to come up with a compelling idea that fulfills the former exigencies, they should consider returning capital to investors rather than creating a rebound company. Persevering through multiple pivots is usually the worst outcome both for capital efficiency and esprit de corps.
Comment your thoughts and questions below. If you’d like to chat further 1:1, you can find my Office Hours here.
9 months ago
1
Protosphere is the front page of the PL network. The name is a portmanteau of “Proto”, representing Protocol Labs, and “Sphere”, as in an object’s sphere of influence of planetary pull in space.
Protosphere is a place for members of the network to build out their sphere of influence. It is a great tool to share your thoughts directly with the network and get engage with other members via comments and groups (coming soon!)
Most posts and features in Protosphere are private and require you login with the same credentials you use for the PL Directory.
Home view:
Topics view: (second icon on the lower left side bar)
To make it most time-effective for you, it is recommended that you post articles or topics that you’ve already written about elsewhere, whether it’s a blog post or announcement email or Twitter thread. Pick topics that you would like to get direct engagement and feedback from members in the Network.
Some good examples are below:
If you have any questions about ProtoSphere, or come across any technical issues, please reach out immediately to spaceport-admin@protocol.ai.
9 months ago
0
This guide teaches you how to search for and connect immediately with PL network members using Office Hours. It also showcases cool ways other network members are using their Office Hour links.
Think of Office Hours like what your college professor used to host before midterms. Office Hours in the PL Directory give you direct access to scheduling a meeting on someone’s calendar. The link is usually a Calendly or Cal.com URL. Scheduling Office Hours with someone allows you to save time sending cold emails or Telegram messages that never get a reply.
Only members who are open to giving a select chunk of their time to Office Hours for the network have these links on their profile, so you can feel certain to get a response. Please be sure to state clearly the purpose of your meeting, show up on time, and be prepared.
You must be logged in to the Directory to see Office Hours. If you don’t know how to login, follow the instructions here.
**You can also use the Skills filter on the left-hand side to narrow down your search.
Check out Office Hours Guidelines and Tips to learn more!
If you’d also like to provide Office Hours for the network, follow the instructions below to add an Office Hours link to your profile.
9 months ago
0
The PL Directory is the main source of truth for network membership and your best way to stay connected and find other members in the PL network.
Please follow the instructions below to login to and update your profile. If you have any questions, please email spaceport-admin@protocol.ai.
Because your email is very closely tied to your Directory account, updating it requires an additional verification step. If you need to change your email for any reason, please follow the instructions below:
Make your profile more searchable by adding your professional skills. This is something that people can filter by when they search for members to connect with.
To update your skills, login to the Directory and follow these 3 easy steps:
You can increase the ability for folks within the directory to connect with you by updating your additional contact information and social handles.
The privacy settings in the directory will allow you to choose the social and contact information that you share with the network. If you haven’t added any yet, make sure you go to the Social tab under Profile first.
Share the contributions that you have made to projects with the network to allow members to understand your areas of expertise and help them find you.
If you are the lead of your team, and your team hasn’t been added yet, you should do so as soon as possible so your team gets included in network-wide events and communications.
*NOTE: You will need to be logged out of the directory when adding your team. To log out, click the dropdown arrow in the upper right corner, next to your profile picture, then choose “Logout.”
To add a new team, you need to complete 2 steps: 1) Add a Team to the Directory, and 2) Add it to your profile.
Your request will be reviewed by Spaceport, and once it is approved, you will receive an email notification that your team has been successfully added to the directory. This should take about 24 hours.
If you are a member of more than one team, you can click “+ Team and Role”. Then select your new team and enter your role. Don’t forget to click “Save Changes” when you are done.
Other members in your team can now do this as well. Please share the “Add a Team to your Profile” instructions with them.
If you come across any issues, please reach out to spaceport-admin@protocol.ai.
9 months ago
0
Full video here: bit.ly/PLSummit23
12 months ago
2
PL Recruiting Resources
The PL Recruiting team is excited to launch as a standalone company in 2024. The mission has always been to provide exceptional talent and recruiting support to internal Web3 native teams, and is now taking this commitment to a whole new level. We are excited to keep partnering with the PL Network and friends of PL who can expect top-notch service, with added benefits like pre-hire analysis, optimized recruiting processes, offer delivery consultations, reference checks, and more. If you would like to learn more or schedule a discovery call to see how our team can help scale your company, check out our website at recruiting.plnetwork.io
12 months ago
2
For start-ups with an eye on international expansion, having a structured global benefits strategy in place from the outset makes scaling easier. It provides a flexible framework that can adapt to new markets, simplifying the onboarding of international teams and ensuring that expansion strategies are agile and responsive to global market conditions.
Benefits inside the U.S.
Wellness Programs: These can range from gym memberships to mental health resources. While some wellness benefits may be cost-prohibitive, partnerships with local gyms or offering in-house wellness seminars can be cost-effective ways to enhance employee well-being.
Benefits outside the U.S.
When start-ups have employees working outside of the United States, crafting an appropriate benefits package requires careful consideration. International labor laws, cultural expectations, and the logistics of international business operations introduce complexities. Here are several key factors stat-ups should consider when extending benefits to international employees:
Crafting a comprehensive, compliant, and competitive international benefits package can be complex and usually requires professional guidance. Start-ups often work with international HR consultants to manage international benefits effectively.
Benefits for contractors
While contractors, freelancers, and gig workers typically don't receive the traditional benefits that full-time employees do, companies can still offer various perks or resources to attract and retain this valuable segment of the workforce. Here are some creative ways to provide benefits for contractors:
When offering any benefits to contractors, it's crucial to maintain clear contractor-employer boundaries to avoid misclassification issues. The relationship should comply with the legal definitions of a contractor’s status and adhere to the regulations stipulated by their countries regulatory body.
12 months ago
2
In 2023 the Protocol Labs recruiting team partnered with over 70 network companies to help them structure their talent acquisition processes and scale their teams.
The team has hired for a number of senior level roles including two at C level. We have worked on and have successfully placed many “Head of” and “Lead” roles as PLN companies focus on building out their leadership teams. We have also seen a trend in companies recruiting their first Marketing & Sales hires as their products / services mature.
Working in close collaboration with our PLN companies has enabled us to provide tailored support to companies looking to scale whilst also building out their talent acquisition processes.
1 year ago
0
This detailed technical report features 7 PLN teams sharing their expertise in zero-knowledge proofs at a pivotal moment in time. The primary focus of the research is on the inflection point as the zk proof landscape transitions from research initiatives to serious business. This original analysis is based on first-hand insights gleaned from leading companies within the Protocol Labs Network, including Cryptonet, Gensyn, Ingonyama, Lurk Lab, Polybase, Rarimo, Starkware and Zama, that have made significant contributions to the realm of zk proofs over the years.
Leading experts assert that zk proofs hold the potential to disrupt a wide array of industries, including finance, healthcare, luxury fashion, and decentralized systems like blockchain, ushering in a new era characterized by enhanced security and confidence. Independent research indicates that zk proof generation is set to grow to a $10 billion market by the year 2030. The forecast for 2030 anticipates a staggering demand for nearly 90 billion zk proofs to power Web3 services, with an industry-wide capability to execute 83,000 transactions per second.
The comprehensive report deep dives into descriptions of different types of zk proofs, why we are at an inflection point moving from research projects to business-led, real world use cases, and challenges and opportunities in the future.
1 year ago
0
PR agencies recommended by the network
As multiple teams are anticipating a product launch or fundraising in the next 12 months, now is a good time to select a PR agency to support you. We’ve gathered a list of 10 potential partners recommended by the network, including budget range to work with them (here). They already have experience working with multiple PLN teams. We also have a PR agency CEO available for office hours if you are looking for high level advice. Feel free to reach out to the PLN Marketplace team if you need additional support to scope your project (calendly).
1 year ago
0
Interoperability is a major key to the future of Web3 adoption, and composable data — making it easier for different apps to work together and share information — plays a big part in this development. In the latest episode of "Exploring...," Andrew Hill, co-founder of Tableland, a permissionless relational database for Web3 natives, talks about the current limitations in how data is stored and managed in smart contracts. We need better databases for more complex uses, like changeable NFTs, Hill suggests, emphasizing the importance of organizing data in a way that makes it more useful and powerful, especially in the evolving world of Web3. Watch the full episode here.
1 year ago
1
Cryptoeconomics is a multidisciplinary field that combines elements of game theory, cryptography, distributed systems, and economics to create new paradigms for digital interaction. In this video, Mike McCoy, the ecosystem lead at Protocol Labs' CryptoEconLab, explores the significance and practical applications of this new nuanced field for developers, founders, foundation members, and anyone interested in the evolution of decentralized networks. Watch the full episode here.
1 year ago
0